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ABSTRACT 

This paper is essentially em interpretive review of 
the literature on accountability as related to instructional programs 
in higher education. It is directed toward academic administrators, 
although others in hiofher, education ^ may find it useful* 
Accountability was treated as "an essential set of transactions 
pi^esent in every relationship involving two or more individuals or 
agencies where: (1) there are expectations regarding performance^ (2) 
those involved cannot remain in continuous, proximiny^ and (3) at 
least one of those involved has the inclination an d^ capability of 
influencing the behavior of one or more of the others. It was assumed 
that accountability is already functioning in all existing 
institutions and that it would probably be more coagenial ajid 
productive if improvements could be made in those activities 
involving: (1) establishing and clarifying expectations, (2) 
obtaining and disseminating quality information* and <3) making 
adaptive responses. A review of current conditions regarding 
accountability in relation to undergraduate instruction would on i^he 
surface suggest that almost any change would be an improvement^ 
proposed changes must be evaluated in terms of the threat posed to 
institutional autonomy and academic freedom*. {Author) 
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' ABSTRACT 



llns jxiper is esscntMilv jii iiUerpfeMvc rt-vevv ol the litcjiU'O a^-vMiiiVit "f.t'v 
rei^Ked to jfiNtruct 'on.ij pro^i.iHjs in liigher tujCjdon It diax?Cvl !.>y,4r>i j^adcir 
idfiiirusfrjJuis, jilliougli oilicrNii* lng[ier cdiKjfuui nM% find it lisctul 

IIkm§ isvontusii^n and d^agrocnicnt about ttie LUULopt o!-acV*uiiiMhi!it> dtpauh-u j(<. 1 
I'l liie literal uro Man\ persons percci\e it uf be a svstepi" ol obiigjtoi% jnu puin'Av 
aLCOuiitmg lo he ini|X)^ed f>n colleges aiid uni^eFsU'Cs hv othei agencies and f>»i tacuifi<.N 
nienii)ers ot an adnmustrative luerarcii). Some Lotitiise U with o\h:r v(jncepi\, e j. 
evaluation or aL^^reditaiion In Ineb'-^r. education a^countabilitv has developed Nvilho'i^ 
thoroiigii examhiation and without systematic ettort to improve its viabihtv 

\ 

ALLOunlabilily was treated as an csseiitiai set ol irans.Riions present sn oveiv 
rclationsfnp involving ivVrO or more individuals or ageticies where ( 1) theie ate expe<.tat!ori» 
legaiding [Krlormance, ( 2) those involved cantiot reinaui in continuous proxinutv. and t3> M 
ka^t one oi those involved has the iiiLlinatnin and capabihu oi inlluencnig ;he bchavu>r ^1 
one or nioie of the others, Ij was assumed that act.v)untabihl> is already lutictioiiijig ju all 
existing mslituhoiis and that it would probably be more congenial and prodtiutive ;f 
improvements could be Made iii those activities involving {\) est-ablishmg and clarilv uu'. 
expectations, i2) obtaining and disscniinaling quahtv irdormatioiu and ( UKiking adap* i\j 
responses 

While a review o\ current conditions rej^arding accountabditv hi relation 
undergraduate i/ist ruction would on lite sui face suggest that almost anv change would he an 
imprcwenient, pi o posed Lhanges jiuist be evaluated m terms of the threat posed lo 
^istitutional aUtofif>m> and faciiU) academic lavdom While academics traditionalK have 
traded autonomv lor other benefits, and while lt^ value vanes greatly trom scliool to school 
jnd one ge(«gr.t[)hic ^irea to another, atademic tVecdom is alnu^st universally regarded hv 
aLademics as the most highK valued of all educational goals This NUggests that an\ dianizes 
in a^,cv>un(abilit\ that ^an be sliou»i to improve aeademu. Ircedom should ttnu a liigh decree 
o'i ciillv support 
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PREFACE 



p^'TK^l ni.ilcniU S'>imc ihcw tur^c j[)pcaK\i in publi^iv ■Jisir-iniieJ jv'unul^ tfulW^'oM 

t 

fiic pniR.p.il vfiicfjon lor ^^fccnuig iiiatcrjjK tor niLiUs.ur' in tlMN rcpiut v.js onv (u 

juiiinnsUJio! ^.ngjucj 1:1 pLmiiifii: change wi .ns!iULti.)nji aLn.>un:ahiUt\ \Mihiii 
ris lit r lUsdUithJM 

\ 'Cl.^jju ^MtcrMij' lor -L^coijjnu inatcriiiK was (hat ihev >h<)uM Nvus •)!» insuu^n-uiai 
**'i?piU^. e . lliv'sc va'jahics nio^J ^!ovl\ rClated to the dohverv in^!:uLn'>Ji *^h='e ihi-- 
vfjfition roiiiainCij raiboi Jin^iuuous. instrucUuii vvas considered as a class .oj ,uilpni 
\ an jhlcs dii le-ciU flran iht-sc xerv'ec or research 

Ihc hkiaUiie phAed !'>iH s»,a!tetcd an»J [argei\ uploi^u^ ufi .iLc»>UlKal'dit\ h he*wan;e 
tj.\u (i^ 11! ilie ^^ud> Jha? «»ftK iccont inatenais p.ecdifc e^picned bveji !.;»>^el\ related 
^.,n^cpK x.i.^h jN fe-jfMisvi'n.htv and evahiaiion. did noJ appear exit hSi\civ in eduLatJur»ai 
iaefjliK. Ji->pei tMo!) apphed ^"iti^epj^ until after l^>(>5,anu aei.niiniabiiiu wais^n-.i used 
J' a:. M<i( ( !eat iiiiihoLivc relnovai icjiu anid Ve!> liltlc !«torature was expU^ied uiat 

.!p|Hauti pM»'t h/ l*^^)'^ and iiui^t int-ptathtioii was taken from icsoufve^ v.udc avadebj^' NjiiLC 
( oiinl.-d witl! lie pauc.!^ >■* e irhej intornutiun is (he lariU,' jiiioiuit 01 uitorjila! uui 
■I .r^.". be.iv ^^iciaied l\er\ da\ fiew djfj ^^J jced that '^uyeesK'd chanties in euher \\k 
v» ik«-{"* a^^- ■ant jh.'iV \ or piO(.ei].jre'^ tor iK ipjpicnieiiJation 

Hi^.^ -,.'.n I » i the r^p<',t "A Bif^lin.j: <,i! ii^s'iu<.t;w!iai \cLn.jii.jjf»ii,tv' j 

ii.j'ur V'h:^ it: >fi ' VKIuie "K', m seit^^'ad ihc hstnigs a:e hinstcd to tlmse .ipp.ear'.. 
) .\\ V. :^ '! jcp^'f* !: »Mended thai tiic ^e^fu^Jis can be " a- 

^ep.jiaiL pip'»!iLa;h![r 

jiKiPks at, Ji!j I Viiiai- (jit.ni'i'v BC( laniitf 1 aw^ence.C liaile- \eidt ( aspo? i\mb-n J{ 
f! .! M'k^ R M*ji'C\ t*'. the .iitujUt- lhe\ made -^1 vas'Otis dratts ot tlie p4i|'»cf Miere an 
>>''hv:a!"Mi \i- iht'^v pe'-t>nssh,) s,cu\ letteis. no!»>, cnpubiished papofs and ass.'^>nief • 

^! \'.ev, i' \ al- AM fe[)!;ea ?• e qjio^tmnnaires ii.at w^rc ^ent uul ilie ett-»rts .d 
1 • i'fii^ ( 1'' 'tid 1).!^ ii, >UK\ iU vhetkini! the SvLiir-iev <>( reljeiences, m prepa.tita! the 
I 1 i >i!^>ph,e^. li d !■ ,«t!;!i: •< !^ 'cikOn that weie eiusive are aUo appieLiatcd \n jw.v 
-i.iud.l in .!\' i: Iji'ili (be\M';\ aIjo nianaL'ed travel itniei.uies tvpiiii! pitHiiR?">n ana 
rnnl'n^ ^pcv ! ' !!]a']ks arc ^lue I m Waitc ssh'^ ideiit-tied Minnnaif/ed. nui ji^lcJ tn 
i' te:prv.rai^ jnuch mI M.e pi.ikr'ji vobeML 1 
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iNTRODUCTlOW 



\ccninH.jhi!il> jp higher cJucdlion has cXislcJ as long higher ediiealion itscli 
( ollcgcs an'.i univorsilics have been accouiHablc For such obhgaUoiib ;ss pruviding scrviceN (o 
oilkr, agencies of wciely. e.xpanding (he fronuets of knowledge, meehng sland^rW^ 
esiablished b\ jccrediling agencies, tiaunng graduates to meet ccrlauujiianpowei needs, and 
lor siewardship of rcsouices appropriated by jegislaUiics. Professors have been acCdjJtuabie 
tor pl.inning^instriicliOH. meeting classes, a^.signuig educanonal activities to students, 
measuring pci^forniancc. and awarding grades. 

^ 

lii.ver>' c^ent years accountabihty has apparently ucquired either new meaning oi . 
difterent emphasis. In the literatiirc-of grofessional education., and m messages directed to 
the general public, the term is used^ as though it describes a iifw phenomenon 
\ccounlabiiity. as a word. \s employed m so many contexts and as a descrj'pto! Cor so man\ 
activities th.it. as CJIass ( ^^2) observes. "The term drips wjth excess meaning" (p. 630) 

Fills report 1^ an interpretive' summary of the literature on accountability as I't rcMatesio 
instruction m American colleges and universjiies. It is addicssed to a specific audience 
K'adeniic adamimstraiors m coHeges and untversiiicb offering four-year prograiiis 
undergiadu.iie education, hs purposes are to 

> ° f 

{a) onen! Mie audience to Lurrcn^thinkmg regarding accounta'bilitv , 

(-iO w«nwr,ttuie toward mor<? effective discussion, discourse imd debate icgarding 
acc<Hintabtiit\ , 

tc) provide tlie audience wiiKTmuide to the hteratuie of accountabiiitv ; 

■ ' I 

(dj dcNvribe some feasible <a)pioaclies to^iptimi/ihg accountability 

In I'iC imiud ^iiapicf ni Mos repi)M. ihe \ocabuiaiy onipi(.;\ed m communicating abv)u( 
jistruvifOiial at^'inmtabih;> is discussed, Attei the current definituMis. n:.>dels .md tooN oi 
j^coufMahihiv jiavo bcen^ cx*plorcd. a paiaOigm is'presented ^hiough wIticJi instructional 
.'^^<uint..biiit\ .Ml iui!i>er educaliun can be exairfmed. The leuew m tlie sccouvi chapici 
!i>lus'. > on tLe idc:Uil'tati»>n .iiul exaimnation ot barners,to improving .iccountiibiiitv Aud i^n 
! disi.us^i.Mi nf ua>s' iv, \\hicn ti^K* harriois might be i)roaciiod. Implications of the par.idigm 
lor adnnni^i i.iii^e pi^iciice arc discussed m the tinal chafiter 

llie fcade.' sluiuld '^oie tiiat thus mtcrpreliNC summary coiUanisvery little that is based 
'i)n expcumenMtn)!!*' \s lloug^h (•}^)"0) pt)ints out. there is undoubtedly some relationslnp 
beiween failure provide an accpt^blc understanding of what education has d(Mie and is 
d^'iim and the \,Ki that onl\ 22 peiceiU ot the total buduet foj education lias been spent on 
eduv.at!onal reseaieh l'i(?m an examination ot thei^erature. it soon bocon.es appaient thai. 
^Iie anii»»int of institutional lesou^ccs sp^^nt \\n nnpio\mg eitliei mterna) ui ext;:rna! 
accountabdity must be negliujhle Tiie sus^gcstions that aie made thioughout the report, and 
tiie app^Mfwhes Jc^^nbed m the linal chapter, .i o-b.ised on the writer's interpretations o! the 
.ibvMVatjoiK. riidgments. and opmions ot intornrcHl and experienced individuals MnioAi 
nothing 111 {ln,s report that can be tonslrued to constitute a recommendation caV be traced 
to the lindings of expc^^uiental rcseaich ^ ' 
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CHAPTER i 
PERCEPTIONS OF ACCOUNTABILITY 



Definitions of Accountability 

\cLomitabiiity employed in the literature in ,i varsetv of 
wa>s The mu!tiphLit> of ways the term has been u^ed has led 
Mkin (1*)72) to suggest that simple description of the ^.ui is 
not possible When GlaNs ( 1 972)^descnbes accountability as 
another term in education ihat is permeated witii "resounding, 
vacuities*' (p. b^d), he seems lo be implying that, unless some 
commonality of meaning can be ascribed to it» accountability 
Will soon beconie a» dysfunctional term 'in ecjuuatonal 
amimunication. , * 

* rlie Center for Instructional Research and Curriculum 
f'valuaiion (l^'^l) states that "Full accountability depends on , 
people agreeing about what the goals are and oh people 
knowing 'the progress toward these goals" (n.p.). Barro(l970. 
p, I9(>) suggests*(1i^t>i^he basic idea conveyed by the concept 
* \ - . IS that school systems and scliools/or more precisely, the 
professional cduc*rtors who operate them, should be held 
lesponsible for educattonal oiitcomes-for what children 
Icam.'* Wildavsky (1970, p. 213) says '*To hold someone 
atcountable is to assess how well he is performing/* Stake , 
( 1973, p.* i) says' 

Accountability, in a strict sense, means to h.Ae 
gi>od rec()rds and to make actions "open-to-view. ' 
Sinctlv speaking, an accounlable^^sLliool 's one that 
M) discloses its activities, (2) makes good on staff 
prtimises, f3) UsMgns s\aiT responsibility for each ^irca 
ui public x'oncein. and (4) monitors its teachir.g and 
leanung. Some ^spokesman extend the dellnition of 
the accouniable ' school to (5) one Uiat gathers 
evidence of mak'^ing good on piibhc expectations, {Gf 
l oe that ihiough-^rcsearch discovers^ne~caiuses of 
trcngtb' ami vveakncss, and (?) one that pn^ides 
V t>si-L } feet iveness information on alternative^ 
proiiranis. The exteiulcd definition is one Uiat • r 
' vciim^l can stiive to live by* but one that because ot 
mir inability to mcas'uie tliese things no school can ^ 
fresonily fuinil. The lesser definition is a reahst.'c 
t^hhgation. 

l o Alkin (1972, p. 2) "Accountability^ is a negotiated 
relaiionshi|J in which the participants agree in advance to 
accept specified rewards and costs on the basis of evaluation 
findings as to the attaimnent of specified ends." This 
pencption of accountability, as part of an economic agreement 



jor exchange of information, as in an act of commerce, seems 
to fit the model suggested by Glass (1972*), 'The simple 
economic relationship of vendor and buyer ms- the pi ope ^ 
paradigm for analyzing educational accountability. An 
accountable relationship between seller and buyer involved 
three elenients. (1) disclosure concermng the profluct di 
service being sold, (2) product ur performaiiLO testing, (3) 
redress in the event of false disclosure or poor perlormaiiLe'^ 
(p. 636). 

' %. 
least fotir writers perceive accountability ppimanly as a 
inanagement concept. Lieberman (1970. p.l94) writes that, 
"At a common sense level, there is accountability when 
resources an i efforts are related to results in ways that are 
useful for policy making, reso\irce ailoation, or 
compensation." Lopez (1970, p. 231) ^akes the position ijiai. 

Accountability lefers to the process o^ expecting ^ 
each member of an organization to answer tn 
someone for 5/ doing specific things according io 
specific plans and, against certain timetables to 
accomplish tangible peiTormance results. It assumes 
that everyone who joins an organization doos so 
presumably to help-c in the achievement of its 
purposes, it assumes tliat individual behavior which - 
contributes to these purposes is function,il and that 
which* does not is dysfunciionak Aecountabihiy is 
intended, thejefure, to insure that the hchavu)r of 
every member of an organization is largely funeoonai. 

ilyer (1971, p 4) describes accountability . as '\ .a 
management concept or policy. It involve^ ,igrc^i{ng upon 
objeitive.,, deciding upon the input to, achieve the objectives, 
and measuring th^: output to see the degree to which the 
objectives have been reached. In even simpler terms,. we must 
llcLide what we are going to do, do it, and then prove wc have 
doiv it-aiid perhaps how well we have done it " Roucche, et 
al. (1971), have a two'pait management oriented definition 
that suggests accounting both external and internal to the 
institution, . . an obligation of the college to answer to its 
constituency for carrying out delegated responsibilities^ the 
oblig"htion of members of the college to produce and account 
, foi results, tn terms of objectives or assignments vvIhlIi ha\e 
been delegate(r\(p 23). . ' 

Lessmger (19''Ua), who is Lrediied with stimulating the 
current interest ol educalois in a^^countabilitv , ascribes ,1 



\anci> of incanings io the ,conccpl dc|>ciiding on* the 
ininiedia/e aiiswjrr lo the question. . who is iiccunuJ«iblc U) 
*Ahom'^" (pp. 107 117) Perhap* ius clearest statement 
rouaniing tlie term is. 

Accouniiibiiflir is-tlie product ot' a proce*;;,. At its 
nujsi basjc level, it means that an njient. public ur 
private, entering into a contractual 'agrecnicnt to 
perforr\i a service will be held answerable for * 
pcrrorniihg according to agreed upon tcrnib, within an 
established time period, and w,th a stipulated u^ of 
resources and performance standards. This defimtion 
of accountiibilitv requires, thai the parties to the 
contract keei^ ctear and coinple'te records and that 
this information be available for outside review. Tt 
also suggests [3cnalties and rcwaids, jccountabilitv 
without redress or incentive is mere rhetoric" ( 1970b, . * 
p.2i7). - s ^ - 

* 

Neff. Rands, and Lope/, perceive rhe concept 
responsibility as closely linked to that of accountability but 
attempt to make a iisefurdistinction bctv^een them. Neff^ 
i I p. 14} proposes: ' 

.. . that 'responsibility' be used to refer onlv to the 
voiuntar> assumption of an obligation, while 
'accountability' be used to lefei to liic legal liability 
aj>signed to the performance oi nonpertormaiite of / 
certain atts or duties. 

Rands (127Kp- 1) indicates 

riiere arJ^al least tt^ kinds of accountability /fhere ' 
IS that wnich akin\i a sense of rcbponsibility and 
derives from an inlemal desiie or commitment. Thij* 
kind of accountability is impervious to ourside 
persuasion and pressure. Indeed, it makes* such 
external persuasion totally irrelevant and 
umiecessar). The other kiitd of accountability is that 
which IS akin to expectations and derives from an 
extenlal demand. This kind of accountability is set by 
others and is based on their expectations. Tins kind 
of accountability depends ^on external pressure and 
persuasion to make it functional 

Lopez'' (1970, p. 231) says. ^'^Accountability is to be 
distinguished from rcsVonsibihty by the fad that the latter »s 
an essentia! component of authority whicli cannot be 
delegated/' ' 

Mortimei (1972), focusjng on higher education, lias 
attempted to analyze a -variety uf interpretations of Ihc 
accountabilit.y concept He pprceives confusion abpiit 
avcountability in liighei education as developing lioyi three 



.areas ot coUcCiii m.m.ii'^ji uii jcLOiutt.ibihj) . .ic^.uini.ibihl) \- 
evaluation, and ac*. ouiuabjiitx \s lo^goi-Mhilil) hs 
iiileipretation ».oiitrihuics l*) undcisiaiuhng the lyst and Iim 
of these «;oncerns. ' bui obkiNcatc^ the distiiKtion' beuKccp 
evaluation and acciuni!abilii\ by tailing explicate 
.HifficieiuK the ci.iucpt vW cNaluation Siiue c.ich cv)nccpi in 
the t^ibjct.! uf a vaiiety of pciccptioiiN and mispercopiionv. the 
la^k of punidmu [)eispicu^y w.is a forimd.ible one 

Mortimer doe."> quik*^ .i usct'uUlr>j3nctU)n between external 
accoiintabiliV aial hiiernar 'unial)ljity In Ins \ic\\. 
external acco«riUjbiiii\ iirCoKo^ aceountin^'^i<« ^vxicty and a> 
in:>titutions. Uie exectitne bi^iich of t^ovcriiincm, state 
legislators, and courts and enl or cement .igeiHics. Iniciiial 
.iccon^ting IS concerned uilh issues ol contioL authoijt). 
manage men I. .go\crnancc. goal setinig. infoiniiition pii>co^sinii. 
and evaluation. 



ModelS'of Accountability ( ^ * 

* ( ■ 

Current emphasis ni the Jiterature >>ecms to sugge^l that 

both internal and*external instiiU'ti()iKir accduntalvnity should 

foc^is^on outputs althougll the C arnegie Comijmsion Kcfiori 

(April, .1 97 1 ). written Juiing the peak of eoiicern .ilfout 

account abilit\ m hmher education, only identified'" a siimle 

obligation to be mipose<l by pubh'c nigejicies'tipon coHcgcs .ind 

uiiiver.sit!c\s iha4 could be consuleied an outoiJine i elated lo 

student attrib^Hes"^ institutions arc to develop pi.ogiams 

lesponsive to certain manpower q^eeus (e,i».\ lined feme). 

\ ' ■ 
Alkm ( 1972) suggests that it is oversimp|istic to insist on 

the unidimensional view' that personnel educational 

institutions are accountable ur they are not. He j)ereeives tluij 

different people may have different primary obi ig.it ions .md 

that, they pertoim these obhg.itiuns to different degrees oi 

proficiency! Glass (1972) suggests that accouiitabiiit\ should 

take pldce^ ufat least five areas. (I) curriculum. ( 2) student 

growth and well being,^) personnel, (4) linances, and (>\ 

legalitv. 'Dyer (1970) advises attending to four groups ot 

variables. (1) .nput. (2) output. (.3) suj-iounding conditions. 

and (4) educational p^)cesscs. 

Almost ail model huildeis indicate that instructional 
accounting must be concerned with the extent that students 
are changed dufiiig their exposurb to ccrt.iin educational 
contexts, if .r jKoJut-Ui)!! model of education in enipluycd 
(Figure I, Blown. I9704p, then input may be pciccivcd 
as entering students, plus whatever attributes tliey possess, and 
output !s peicAved as the same student pkis. whatever 
attributes they possess, at the time they exit from a progr.un. 
rhe model is appropriate in consideiing time ^ spent m a 
particulai course or in the entire cducation.il piog!.im of an 
nistaiition. Obviou>ly it is extrcme'iy ddlicult toUetcnnuic the 



extent of cluuigc vuiunbuted b> pdHiLultir clenietit ot the 
environment during a student's sojourn in college. Thus 
difftcuh icspecify what is-ex.f^ccted of a given professor af 
impoiisible to determine vvlrQ or what led to the success or 
Jailu^e of ii given student or class. Obligations L.innot be 
afilxcd, nor outputs attributed. • 



Input: Vauie of 
-"Goods in PriH.es.%* 

uhcn received by 
Inglier education 



Environment: ^ 
The PfoduLtt^i 
F^^ess 



s t 




Output: Value of 
. ''Goods in Process" 
when shipped out 
by higher education 



1 the cnviroiui^ent to become 
ygJiCf. cdiivation is tu add 



Input 
uutjnit 

value to 'the input (students;, as it palises through'the , 
environment (college). 
^ • • Pigurc I . The Simple Mod 

•■ • . ^ I 

Both' Brown (1970) and Dyer (l'970)'have posited the 
development, of indices tjiat would reflejt the extent aii 
educational program has. produced change in students. In a 
very rougIv%ay these indices may be compared lo such 
economic concepts as" the Consumer Fnce Index. , 

f.conomic models, which the iUpui-pcocess-output 
model was derived, arp, usually (KMicerned with whether the 
value ladded to Intuits (ihe net value of output equals the^gross 
value of output nuyzis the gross vahic of input, Brown»( 1 070), 
li worth the coHli)f the envnonment (production process) to 
obtain it. Siwh decisions require value judgments about the 
worth nf cXh output goal jnd in,dicalor of it. These values wdl 
\aiy ^fro'uK person to person and group to gr( Mp and. may 
c^iange ovet time. The Delphi tCLhniques desciibcu u-ler in this 
l^er, and surveying with instruments such as developed hy 
Petersi)ii (1973) and Gross -( 1 971), seem to offer the best 
pos.;'bilities foi processing value judgments, ajthough see a 



^position paper b> Gage (1970aK and an uistrument bv 
Downey.ielal.(l9.S8). 

Educational economists are also concerned W'th priA)iems 
of effectiveness (outputs obtained for a certain expenditure, of 
resources) and with efficiency (relative cost of^ obtaining 
certain outputs). 

In his model for educational management, Kaufman 
{19711 presents the position that the primary ^task of all 
educators is the m.anagement of learning. He argues that the 
' ^educational process can b^ managed in sucli a manner that 
data ntieds forjnternal decision maki'ngvind information fo* 
disclosures are generated as. systerna(icali> as possible with a 
**proper perspective fn alups and valuing'* (p 21). To 
Kaufman those who manage learning in a syste;natjc way have 
an integrated system for improving evaluation and for 
ansvvering demands for accountability, 

/ ' ^ - ' 

* The Jearning management job could be conceived as 
being the planning,, organiziug, djL*si£,T)ing, 
^ impleme'nting and ev,iluatmg of leaning situations 
and outcomes, and' making requirpd continuing 
revisions to assure ongoing relevancy^and practicality. 
li is an accountability process, (p, 21) . 

* This perception is not necessarily shared b> college and 
university professors, only a small percentage of whom ha\c 
any traihing in teaching,or "learning management." 

The six steps of Kaufman*s educational process model are 
shown in Figure 2. Five of the steps are ,shown within tlie 
boxes. The sixth step is represented by the broken line. Nine 
of the tools currently used are shown in the 'Figure "...as 
providing rational and realistic ways of JgSprwing the 
educajjonal product" (p. 23). 
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Tools of Accountability 

^;id:»5n 1972) atjj H>er (1971) poini oui ihM llioro are 
nidii) s\6tcni:» labeled •accoiiniabiliiv " ihaijiiight be beitei * 
cuii^dereJ as toois ur atds in atLOiintabtlit) rather than as 
niodeb. Thev a;e usually .eflceiive lu examining ur- 
comnbiliins to one or more of the basic elemenis of 
accuuntabililv , but faM lu accmnit adequately fur all or 
sufficient number othem. Occ^isionlilly educaluis altempt to 
employ tliem as substitutes foi 'accouniabiliiy. Kaufqjnn 
( 1971) and hjyer (j971) are explicH thai these 'luivc uiiliiy ifi 
then u\\n righ^^. but are best perceived as luub tliat make 
accounting and evaluating possible'^ , 

1. .Iliput - Output Analysis ' ' 

*2. Accreditation 

3. Planning. Programming. Budgeting Systems (PPBS) 

4. Measurable PerformaiiLe Objectives* (MPO) or 
Behavioral Statements of Inst rucnonal Objectives 

5. Education Vouchers 
(}. Performance .Con tracts 

7. Needs Assessmem . ' 

8. Prugrain Evaluation Review Technique (PERT) Xmd 
. Crit ital P;Hh Method (CPM) 

' '9. Systems Analysis 
10. Certification 

W. Methods --Means Selection Techniques ^ ^ 
? 12. Turnkey A.rrangements . 

13. Achievement Testing; pariicularly if Criterion 
Referenced and including National Assessment 
, 14, Independent Education Accomplishment Audit 
(lEAA) 

15. ' Management Support Groups 

16. Performance Incentives or Merit Pay » 

17. Effectiveness Indices or Instructional Cost Indjces 

18. Instructional Engineering 

19* Charters of Aclountability _ , 

20. Competency Based Training 

21. Management By Objec^ivesiMBO) 

22. Information Management' Systems and Management 
* Information Systems (may be computerized) 

23. I'aculty Activity Analysis 

Not all of these tools will be perceived as useful in college 
mstr^tional accounting, but must of them have been used in 
seVuio /urm at some tune tn some institution of higher 
eduLaton. In a sen;»e even education vouchers have been 
L'mpio\ed. e.g., veteran's education legislation has peimitted 
cx-ihilit u) per.sOns to eniei the schools where they can gain 
admittance and to eithei pay tuition from an allotment* or 
through direct government payment. 



Most of these tools arc discussed to some extent in ou^ of the foUowuig 
sourccs,U)P/i/ Delta Kappaih 1970. 52H).(2)/;c/r(5^/o/w/ Ivdmohg}, 
January. m\ J]{\y,(3) Audiovisual hwniction. 1971, 16(5). 



Ab \\\ih the we.nlut,. ii scam be Vxith 
accdiniabilit\ . evervone talks about it. Inn no i)ne doc> 
an\ thing about it The term is used to define an a».inu>. a 
process, a nu)ral cohdaion. .i reLuiousLip and a nianag^mcni 
tool, fhcrciurc. U ^ecnis prc^uniptu'^n^ to aliempl lo .udoi 
the tliaos. Rather than attempt anuiher detiniiion, lU th.l^ 
report Acountabilitv will be deswiibed in tcrniN of junI thiKc 
components tha: bcciii to leuuiie aUMUion it u' is tu be 
improved. 



A Paradigm for Exaniining Accountability 

• To fultlit" the majo'f^purposcs of this report it was 
necessary to accommodate to two comii lions legaiding the 
iiieiature oh accountabihiy. (U the plett^ora of dermiiioiis 
and the general LonfuMoii regarJiiig the mcaniiii' uf 
.iLCouniabihtN . (2) the paij[Lit\ oi e.xpenmcnia! data leadiuii iv) 
cl.trifiCi-tion of the concept oi to desciiptiuns of fca>dTflc 
pxogediires for improving it. partiLuhirly at the college and the 
university levels. This has been accomplished by developing a 
description of accountabihiy that both conlributeN in the 
major purposes and serves liie tVamewurk for orgaiu/.iui; the 
remainder of the report. 

In this leport accountability will be treated as an esseiuia! 
condition, a set of transactions. a>socjated witli even 
relationship involving two oi more individual or agencies 
where; 

t 

* 

1. lliere are expectatioiib regarding perform. uit'e, 

2. there, is spatial oi tempoial separation or 
discontinuous contacts of those involved. ^ ' ^ 

, at least one of the individuals or agencies has the 
inclination ' and capability of mnueneing enlier or 
' both .the expectations and periormance of one or 
more of tli.e others. 

Tjiese circumstances JesLnbe a relationship m \<hicli the 
transactions are contractual or obligatory in nature. The 
expectations may be iP '^lied or tangible; ambiguous 
articulate, negotiated, atbitrated. ui uiiposed. The bCpaialioii 
, of the participants requires a spceial means of tunnauiii^w ituui, 
an accounting. An an^ouni is diaraeten/ed bv its cninent. 
whieli IS focused on information icgardnig expecladons jiid 
perforinanee. This information \vil! \ai> in its uonerctencNi. 
objecti\it>. validitv. .idcquaey,, puritv,* and usefulness 
lndi\iduals.aiid agencies will v.ir> m theif abililics lo ]deiaif> . 
col'lect. ' process, distribute, interpret, judge, and apply 
information. They will also lluctuate m their inclination and 
capability to inlluence others. In a viable eoiitr.iciual 
relationship, attempts to innucuee uihois "should be seen as a 



cunsCiiuciigc of l)ic accounts prmiUcJ. ConHCquoiiLCS or 
may agi be .funciional, punitive, adaptive, rcinfofcuig. etc. 
These consequences' themselvCvS become port of the history uf 
the rcKiliuiibhip and inriuence new e.xpectatwiu,^thc cxtenu 
l\pe. an^i exchange of iiifprniation, the relnmce uii 
infornijition, and subsequent consequences. 

Wheli view'^d in this light, accountability I's ^the 
iransiictiunal sine qua mm of a (.ontfactuaj relationship, li 
cannot bp introduced ^Nificr-ihe^fact.** It can be demonstrated 
and maintained. It can be ^nprbved. It can be ignored onl> at 
the risk^of creating a relati^Hiship in v;Kich actions are crisis 
junented. Frequent crisis responses over time^'tend to weaken 
the relationship and create conditions for failure. 
- « t ^ 

It W15 assumed that, for better or worse, accountabiht) is 
alread> functioning in ail existing colleges and universities and 
that it would p,obably be more productive if in;prpvements^ 
could be made in those ^ activities, relareti to the basic 
characteristics of the rerahonsliip in wiiich accoi^nting is 
necessary, Tliat is. fmpiovement is needed in: 

!. Establishing and Clarifying Expe'ctations. Throughoui 
the literafurc there are discussiot^s relative . to 
obligations, duties, responsibilities, strategies, 
transactions, intentions, products, inputs and 
outputs. It is obyious that theoretically and' 
practicalljf vaerc is very little agreenrent as to what 
people wiihin institutions of higher education expect 
of each othei, or what agreements have been reached 
between Jolleges and other social agencies. While 
little IS known about what various people expect, less 
is known about the validfty of those expectations. 



Included here Js unverl>nnt> abtnij ^hat ^it|i!»tii"utc^ a 
justifiable request for accounting. 

2, Obtaining and Disseminating Quality hiformaiion. 
^ While. decision theorv would MiggcM tliaC mt^urmation 

bhould reduce unc^riaiui) *n decision making* ihiJ^ 
principle does not *sec*ni obvious ul colleges and 
un ive I SI ttes. The A^ry ternT^aLCouniabilny suggest 
sum5 fonir of int'urmatiuii cxcluiige, an ^Lcuuniiiig. 
' But the basic question of atcuuntabihiv stdl ion uns 
* the^ ke> tu-ttnprovrng the rclatiuitship, "Who cxpc^^ti 
whom to do what?'* The^ aji^wer. or answeri>, 
require(b) some attention to (ft paid (i^ content, 
quality and timelinel>s of information, and 'HOLcdurcs 
for its exchange^ Instructional accountability in 
higlier education will require that nifornianoB. be 
.obtained through '%iCLcptablc" procedures-^ of 
assessment. ■ ^ . . 

3. Making Adifptive Responses. In Jieury at least, 
information should lead to. (!) clarinifatpu 
maintenance, change, or termination of the 
relationship of the agenl>' or agencies in%\^)lved. (21 

, one or. all of the parties involved changing their 
'respective expectations or^opcu^ations. and (J) ^oine 
. ^ difference In output from either th^ mdividuals,jhe 
agencies, or the institution. , That is, iljc iloal. 
consequeiices of accountabiHtv shc5uld be 
cla^fication, restitution, compensation, reword. ^ 
* correction, redress. mo4^cation, or retribution. 

Badi of these elements is suggested as requiring attention 
if accountability is to be viable. 



CHAPTER II 
IMPROVING ACCOUNTABILITY • 



li is proposed ,thai accountiibiliiy would probably be 
more productive^ if ftiiprovenients could be made lii; (1) 
establishing and clarifying' .expectations,'X2) obtaining^and 
disseminating quality information, and (3) making adaptive 
responses, in this chafter eatli of iliese elements is examined 
in terms ot^: Q) barriers willrtn it that may inhibit viable 
accountability and (2) feasible approaches to alleviating those 
barriers. ^ 



Establishing and Clarifying Expectdtions , 

* « - 
h is difficult to establish expectations for either colleges 

or individual professors because of the plurality aiid 
help rogenity of the people involved. Expectations for a collegt 
are usually expressed as statements of goals or objcctivcR. 
Brandl says, '^Higlier education is maiiy things to many people: 
it is iippossibic to eonipilaa self-tonsistent, yet complete list 
of the goals of a unix'crsity " (1970, p. 85) Tolleu's ( 1970) 
rC| >rt also implies that universities just may be trying to 
aciiieve incompatible goals. Yet Hind (1971) thinks both 
individual and group- goals can be accommodated, although 
they must be in harmony. 

=^ f i| is difTicuh to determine 'the extent or type of goi\\ 
discrepancies because what is reported or what can be 
observed is not always accurate There is a-positioK expressed 
that, the university should actually encourage diversity of 

.gfc>alS', e.g., Brandl (1970) s.iys, '"a university is designed mi f6r 
reconciling conHicts. but for permitting them . . . there is no 
agreement on its produc^ . . " (p. 87), The*!>tud> by Gross 

tl97|) would .suggest that there is less disagreement among 
staff meyibcfs und schools about instiuitional goals than there 
IS difference in emphasis placed on them. This o|)lnlon is 

%ppor{^d by Brown (1970), " * 

* Ail values^ should ^hot V mcorporated'into the goals of a 
college. However, the opinior^of a vifriety of constituencies 
must be considered if. external accountability is to be 
improvell. Lack of such 'information reduces the ability of the 
college, to act responsibly, either in us own self interest or that 
qf SOCIO ly.* ' ' ^ ' 

I Petersen v( 1973) found the local citizenry of California to 
be out of sympathy with what they perceived some campuses 
10 be doiTi^ particuhulyjn terms of thbse process goiils seen 
by most acad<\jtm^^ for a'^vkible institution, e.g.. 

fFecH^ii. However,, he suggested that, VLay people ... can 



understand and will accent institutional goals if campus 
* officials will make/ihcjeffort !6^commum^rte" (p. 173). Wo 
recommended that: '-^ " ^ 

, . . . the public at* large. deser>'es to be informed about 
performance ...If done openly and ipiagmativeKv 
such r^iKiering of account could lend beyond 
understanding" and confidence *on the' part of the 
public to 4.ieir active support 'for many of the 
objectives and ideals the state's .colljjges 'and ^ 
universities may wish to wOrk toward in the years 
ahead (r. 173), , ' ' • 



Using Published Goal Statements^to Ictentify and 
Prioritize'What is Expected of a College^ 

Institutional goals Jiiay be used on a campus to. ( 1 ) .serve 
as a basjs for policy. ,(2^act as geneial decision guides. (3) aid 
in planning, (4) help establish a m;inagemem intV iiKition 
system. (5) guide instit^itional evaluation^ and (6) implement 
accountability (Peterson, 1971). The list.a.s not exhaustive. 
Institutional goal stateniejit^ inay give^pme valid uuhcanons' 
of the hyper, a.^irations; 'ahci pliilosopBies of tho.sc who 
framed them. However, it is rare that these statements are so 
.olirased thXtlie extent of theii aiiaiiiment could be reliahK 
assessed. 

i 

Rathei tJuin investing faculty lCsuurLe^ m developing a 
statcnrent of goals, it may be more fe.isible to lake some 
existing statements of goals, add some statements il tl!6> seem* 
neejed, and engage faculty's efforts \u pnoritiz?t*g thei?t 
Si'milar ^ procedures, employed by both Gross (1971) and 
Peterson (197,3), lequned respondents to indicate both lunv 
they saw a prestated goal as being achieved, ,nnd the extent 
they would Pke it to.be achieved; The results theieforo 
ppuvided an indication both of godl achievement and of 
discrepancies that might suggest , nee^s^-^J^ulrjp^ some 
attention and commitment of -j:^(^^^e?^'^>jr^^^^^^ 
(L.iwrcncc. et al., 1970, p 112-1 13) semnSn^jWjje ocifputs ol^ 
higlier education resulted in a list of variablej^ {'MoT -i^e\ie\/ 
pu/poses only") considered to be outputs of Highci education 
and that, therefore, can be treated as goals.. A source lor 
measuring each output was also identifii^tL . 



These three statements of educational gt^s have a 
commonah.ty that holds particular relevance to accountabihty . 
All statements include both the consequences, the jesults of 



activities and 'cofKlitibns, and Mie actjvitic:, or conditiuiih 
thcnsclvcs. Gross classiJied his tWty-seven goahstatcmcnts as. 
(1). output goals. (2). adaptation goals, (3). management goals, 
(4>^ motivation goals, and ^5) positjor7^i!^goals>_geicrson 
separated his'nifiety goal statements Mo two categories: (I) 
o6'come goals, and (2) process goals. WlCHE ended up-Avith 
forty*,^nie variables under the headings: (1)^ instructional 
outputs, (^) institutional environment Outputs, (3) research 
outputs, and {4} public service outputs. While some persons 
may view acccuntability. as ^focusing on end results, the 
expectation^ fo' st^me^^ individuals or agencies', and sonii 
expectations regarding the mstituion -itself, obviously fnclude 
the Vts and circumstances that help achieve those results. It 
appears^ tliose concerned about accountability in* higher 
{education have accepted the reality of obligations related to 
both means and zuds. * ' i 

, • ' ' 

In the same.WICHl: Conference, Brown' (197Q) also cited 
twenty'n)roajd goals* of higher education and listed' forty 
suggested measures 'for assessing them. While these measures 
are rather ^ross. Brown suggests that, "The realistic choice is 
between "no measures'* (subjective judgments) and "imperfect 
proxies" (n By providing alternative measures' for each 
consensus gual, he enables the user to employ measures for* 
which the user has or can obtain data that are acceptable or 
agreeable to him. Furthermore he advocates that if the best 
measure isn't possible, the next best should be resortea to. 
Unfortunatejy, insTh^itlons sometimes settle for proxies that 
are sojc;)<6te fromVvhat could be considered *'bStt'* that 
• information generated from their use is almosi wOrthlfess.'lhe 
Ifigher Educarion Measurement and Evaluation Kit. prepared^ 
by the staff of the Higher Education Evaluation Program* 
(1072) may be the most complete and systematically 
developed set of instruments for assessing colleges and 
universities. The Kit contains measures of: (1) student 
deyelwpnjent,' progress, and attainment; (2) educational 
piocesse$ aifd contexts, (3) Mhe student h( iy, and <4) 
teaalicr/cou'rsb eviduation. ^ * » 

' ^'^ . > ' 

Th^ chief administrator ^at a college or university should / 
assume^he initisrtive for seeing that reasonaBle expectations 
for the institution are defined. The Carnegie Commission 
Report (April, 1971) provides guidelines establishing 
^'appropriate limits of influence and'contror* (p. 105) of. 
public agencies over colleg^and universities. Such guidelines 
may be useful in de^^idfngwiilJl types of responses should be 
made to some requests' r^r information, but the 
recommendations them^lves gerlprally suggest returning to *a 
relationship between colleges ^md universities and other 
agencies of society that is not currently, and may never have 
been, realistic except for the very largest state institutions. . 
N'lnlure by the executive administrators of a college or 
uni\^e(sity to establish procedures for explicating those things 
/ ihe inslliutlon can be expected to do implies that they will be 



established by default. When Institutions oi indiMduals.do not 
disclose their insUUctional intents, the> wilj have (o be 
inferred. Such inferences ma> be.lEs svstematic and /less 
quiilified than if the college administration had assumed the 
initiative. Both institutional autonomy and tacultv freedom 
are threatened by 'the president who leaves the i^^mion at 
the mercy of tife subjective and unsystematic attacks of those 
within and external to the college or university who have no 
basis but their own inferences upon winch to make judgments 
about what the college can be expected ^to do. State 
, coordinating' and budgeting agencies sometimes are better 
: prepared than the college or univeisity agents to make such 
judgments since they may have a broader basis for comparison. 
Glenny (1970) perceives some type of coordinating agency 
essential to statewide planning m Inglier education. One. reason 
l^is ^that coordinatjng agency personnel usually have more 
credibility with legislators who must appropriate funds than 
do representatives from jndividyal institutions. Some college 
administrators have deliberately established programs ol^ 
disclosure and have found their credibibty. to increase ~ to the 
benefit of their'institutions. • ' 



Clarifying Expectations Regarding Professors' 
Obligations tolnstruction 

^In s,ome ways it seems easier to clarity wh^t is Expected of 
an institution than what is expected, of its st,ifll Perhaps this is 
because there is .detachment about obligating an organization 
to do\something. If an organization fails to meet the 
expectations of its clients and patrons the consequences seem 
more imper^cnal- for everybne involved. Instructional 
accountabil'ty vyith/i a college is extremely personaL At' the 
mofecular Itvel it focuses on the expectations others have of 
individuaV professors. While it^^ probably the^^^dents who 
have bepn most instrumental in Bringing about the pressure /or 
instructional accountability (Trent and Qohen, ^L973K the 
expevtatiohs conci^rning teaching behaviors still are largely 
established \>y professors (Hind, 197K/Gross, IST/I). The 
impetus for getting adaptive faculty response. >to. student 
demands or to pressure from other individuals or agencies will 
probably hafe to derive from the administrative, structure. As 
Hind (1971) comments, "Everyone wants change 'and waits tor 
someone else to do something" (p. 286). 

Expectations between/among agents or agencies within a 
single institution establish the tnimework for internal 
accountability. Sdme ofjhese are expressed overtly in fa.culty 
cod^s and handbooks^ published at the institution ot 
employment. Many expectations can be intended as part of 
traditional activities accon]^^aiiyii>g a paiticular title or 
position, a kind of assumed and unw^ritteii job desciipti^. 
This suggests that .issuming responsibility for an assignmenl 
nia> result 1n obligations about wl^ch one was ;iot aware. 



\ 



of these are ver> convcrl and unique io a parlicular 
insliiiUionalt:ontexi. * ^ " 



Both institutions aniKlheir professors value the freedom' 
xo vohnitarily assume responsibilities rather than having 
obligations imposed on them b>; others. However, the^ 
'mipression is given that professors perceive t^ie system within 
'higher education as functioning adequately i» the best 
interests of their clients and patrons and that issues of 
in^tructipnaf accountability are -to be restricted to those very 
few instances involving legal obh'gations. The use of 
negotiators and negotiations as a means of developing; 
conditions for appointment or contract is itself testimonial to 
support thcj^sumption that there is not sufficient' consensus 
rcglirding wlfSTprofessors are expected to do. 



which there are expoLtalions. th'olless is the probjbihtv that 
instructfcfnal performaiKe. or any ^ther sifigle^usk, will^)c 
emphnsi/,ed. »pveralL pfofei^surs are apt lo^,be evaluated 
princtpallv on rcbeaicfi and yservice although ^Ibie 
d.^si:iibes teachnrg as "the pxnici'pal activit) of most 
professors" f p. 4). BJjIe gjes on to sug^e^t that if teaching wa,^ 
just accepted as important, most of tl^e vaguenesj> surroundmg 
obligatioyj> related to it \V(^ukl lessen. Hind ( 1971) reports that 
professors tliink teaching should play a more important xok in 
dctermiaing univers4ty rewards, but they also k now t h at it 
doesn't, and the>; go along with the existing reward system. 
There are few obligationj> related lo teachin^,4ittle is expected. 
Hacquart (1%7'jv m a review of methods of recruitment in 
selected universitiej> throughout t[ie* world, concluded that 
Ht/y pay alijiost no attention to ti?acfiing abili^ty and tli#t it is 
reallv not *t factor in faculty selection. ^ - . 



. The literature (Mortimer; 1972; Rands, 1971) suggesl^*-^ 
that, a^ it is currently perceived, instructional accountability 



has negative coniiotations^q college faculties. This seems a 
' natural consequence of the^^ay the rela(ions)iip is usually 
made visible: In most ihstitiYj^ions onlj a naive professor would 
fail to understand \vhether or not publications were used as a 
criterion for piomolion, Tlie professor is at Icasf roughly 
aware of what 1s expected^in tlje way of standards,' e.g., an 
article must be printed in a Merced journal: knows what . 
infonnation must be provided and who ilymu?!^ be provided to, 
^ e.g., send a* copy of the notification of accpptance to the 
depantment chairman; and laiher realistically expect^ certain 
^^nsequences, e'.g., ^Kadj^stment will be made in salary , or' 
"Vcai)^. • i 

Contrast this with the visibility of what consTltutes a 
favorable relationship in relation to instructional 
accountability. Frequently it is o"fiy if or when a professor is 
threatened with dismissal Scause of teaching incompetence 'i 
that It becomes evident to the indjwdual oi his peers lhati (1) 
there. is almost no explicit agreement as to hisylegal, 
constitutional or professional obligations regarding insypuction; 
(t) whatever information is availaWe regarding his'^eaching 
performance was unsystematic^tlly obtained: (3) there is 
lelative and fluctuating emphasis placed oil instructional 
pcrforiiiancc as a criterion for making judgments about 
employment; (4) there- had been oo systematic effort to 
establish better accountalTility throughout the Institution prior 
toHhe lime of tj\e current crisis: and (5) accountability is not 
sufficiently vahied that an^-effort is maintained to improve it 
beyond the dunRion of the immediatg.^merg^ncy. ^ * 

T^cT^ie extent that this is^descriptive of what 6'ccurs m 
^olleges a\(f univefsities, it seems reasonable to conclude that 
atiemplingUo improve accountability is a justifiable endeavor 
in spite of faculty apathy. 

It should per hjips be noted that the more task areas. in 



_Stake (1971), is a<.lamant that *Mhe evaluation of co]lei»o 
teaching is an inseparable part of the evaluation of the college 
itself* and imphes that evaluation is an integral component ol 
accouiitabihtv. e.g., 'It provides data for the reward of merit 
and for the correction of shortcoming** (p. 1). He percOives 
that teaching can be judged properly only if examined m the 
fUght of "institutional *goals, school environments, 
administrative organi^ation^and operations, curricular content, 
student achievement, and of the nnpact of the progiam on 
various sectors of society'' (p, I). \ 

Here a^e some of the "responsibihtiei*" he cites that aie 
applicable lo. and help dellne the roles of various people in 
ev'aluating'and',*p^haps, accounting: - 

WVdminist rat ive officers should (pp. 1-2). / 

I. *\ . /inteiprej^ the wishes ol/^atrons ai\d the 
needs of clients 'and tianslate . . .into 
institutional goals" . ^• 



'\ . . set 
goals" 



the institutional goals, the long-range 



main t *^Jjlj00' 
teaching ." 



a meritorious level of 



4. 



5. 



collect ^evidence of mefil-and lack 



It . . 



encourage each faculty member to submit 
whatever evidence of merit he can" 

**. . .subject whatevei plans and descriptions of 
teaching are provided by a faculty tnen>l)er to the 
scrutiny or*ex|i^rts in his flcld and in the field of 
pedagogy" , ^ ^ 



Fjailt> members should (pp. 

K . . set internTedlate goals" 

2. "...set the instruclionarstra<egics and tactics" 

3. *\ . , accept responsibility for contributing to'the 
accumulation of evidence of the effectiveness of 
thi^t teaching, that is, the teaching for which 

- Iie/slie accepts responsibility. Such evidenqe ma^ 
:bc both/cither logical or empirical" 

4. provide *\ . . statements of purpose and rationale 
of instruction." Such statements may be formal 
or informal. 



V 



5r discharga responsibilities he has I'aslii.'.ned 
for himself ^it of rtic general assignment given 
him.*." ' 

, * > I. 

6. continuously jnipiove . . liis i^n methods of 
instruction" 

7. provide . . the crijeria for the evafualion of his 
teaching" ^ 



Executive officers and committees should (p. 3): 

1. ". . . e^valutite the* quality of "teaching of each 
liiculty member" 

2. make re commendations for raliik and pay^ 

3% encpurage and fjicilitate improvemeiit of 
instruction by teachers 

The '^institution" should provide "for voluntarv and 
perhaps confidetfflWsnse" (pp. 34): 

I. "cheek lists^f chissroouK laboratory, and field 
conditions wliich have, been demonstrated to 
" .promote learning." 



2. "course-content reviews . . /' 

3. ''observational and remediation services by 
specialists ..." 



4. "student opinion-polling services ..." 

It should be recognized *that Stake's comments are part of 
a position paper, nut a published document, but they deserve 
conskleialion. First of all, much of the imporlanc'? of Stake's* 
papef^is his obvious^conviction that the evaluation of college 



mstruction must be conducted m such a manner as to preserve 
or even cnhanve^cademic freedom. 

The integrity of a college program maintained 
only wfien each' faculty member pe'iceives 
himself-vvithin a cert*ain division of labor-to be free * 
to pursue institutional goals as he sees fit. Officers or 
committees charged with evaluative responsibility will 
^ not infringe on academic freedom with the 
presumption that, there is but one proper way of 
teaching or that there is but one set of educatdnal 
objectives, even for a single lesson. They may nrike 
known to the faculty member certam perceptions and 
Valuations of his past contributions and certain hopes 
for 'the future, but the final choice of intermediate- > 
goals and means of instruction will be his. (p. 2) 

Because academic freedom is essential and 
fequirei restraint \/ administrative officers, the* 

? means available to such officers for redirecting the 
instructional program ace litnitcd^eallocation of 
rank and pay to present faciiltj^^ipie^ec^.will not be 
used for such purposes nor wUrSflocation of increases 
in rank and pay. The officers of the institution will 
modify the direction of a program through logical 

"persuasion, by reallocation of other resources and 
enrollments, by reassignment of responsibility, and 
by employment of additional faculty members, (p. 3) ^ 

Secondly, the list of "responsibilities" and otiiec 
implications in the paper suggest tliat the individual faculty 
member' is obligated to provide evidence about his/her own 
insruction (accounting) upon assuming instructional 
esponsibilities. It is not clear just, what adaptations are to be 
made if this obligation is performed unsatibfacCorily. Evidence 
^3 needed as lo whetliei faculty curr<vitlv accept this as a 
l?giiiniate expectatioa of instruction and tlie extent of and 
^'procedures for fulfillment. / 



(Mature of Statements of Expectations 

As part of this study an attempt was^^ made to secure 
statements of expectations regarding instruction from all 
colleges and univerpities listed by the U.S. Office of Education. 
Tne response was very meager. Fprty*seven respondents 
supplied documents containing 'statements related to 
instructional expet^tancies. Most of these were in the form of 
^ *culty handbooks and their content was extremely similar.' 

I. There was usual ly^.^prnji indication of a line of 
\authorily, a staf^ineht" 'that defined who wa^ 
responsible to Avhom, e.g., thc»Dcan of Instruction 
will report directly to the President. 



2. Job responsibilities were usually more cxplieiUv 
slated for admniistrative jnJ support personnel than 
for the teaching faculty. 

3. Expectations related to researcjh services were more 
explicit tiian those' conccrnc<3 with inslruciion and 
were frequently stated in terms of expected products, 
e.g., papers read or publications. - ^ 

4. Instructional responsibilities were generally staled in 
* terms of activitiSf or function;* to be conducted 

rather than in terms of effects to be achieved. In fact, 
in only one of the documents reviewed was an 
obligation -stated in terms of influiences instructors 
were to have on student attributes. • 

5. There was' u*: ally an A.A.U.P. based .statement 
regarding academic freedom. In i;iany documents this 
was* followl^d by some disclaimer reflecting various ^ 
degrees ^of political and social acceptance and/or 
tolerance of deviations in the community. 

Personal acquaintances report, however, that many 
UHtitutions have developed rather clear statements of 
instructional expectations. 'Impetus far this development 
apparently came from state legislators who were in turn 
responding tc\ pressures created by student demonstrations 
duiing the 1960s. They also report that they arc not aware 
that these documents have jesulted in any extensive 
modiilcations of instructiooal accountability. That is, facult> 
members are iiqi thought to be employing them as guides to 
their own activities nor is anyone systematically obtaining data 
legarding professors' adherancc to the expectations stipulated. 

^ One example of a clear statement of instructional 
expectations is that of Michigan State University (Office of the " 
Educational Development Program, 1971). It was developed 
through the usual procedures of governance in higher 
education, that is. by subcommittees and committees. Note 
that none of the ^'responsibilities" cited indicate that an ' 
instructor is responsible for outputs in terms of student 
attributes. 

Faculty Code of Teaching Respon.sibility: ^ 

The teaching respoiisibilities of tfie instructional staff 
are among those many areas of university life which 
have for generations been a part of the unwritten 
co^e of ^scholars and gentlemen.' Now, howeW^r, 
along with other formerly unwritten contracts, it 
seems appropriate to set forth these responsibilities in 
the form of a code. The provisions of such a code are 
so reasonable to learned and huma|ie men thai it may 
appear »edundant or unnecessary io state them. 



llo\\o\cr. the Liiistjisitv co;ncei\-'N ihem to be m* 
imponaiil tif.ii the pcifoimancc ut the injjtiUttioiial - 7 
itaff in meeting the provisions of this code shali'be 
taken into consideration m dctcniiining ^alar\ 
increases. ien|iie,and promotion; 

i. Instructional statT nicniberb jr*; respouMble /oi 
stating clearly the mstruciional objectives of eadi 
course they teacii at the beginning of each teim. 
It is expected that each instructional stall 
member will direct his^ instruction toward, the 
fuinilment of these objettives. Instructional staff 
mpmbers are responsible to oiient the Lontent of 
the courses they arc assigned to icddi to the 
^ course descriptions approved by the University 
Curricula Committee and the Academic Council. 

2 Insfructiunai hidii^ nicniberb are lebpoiibihle fur 
informing saidents' in their classes of tiie 
methods to be employed in determining the final 
course grade and of any .special requirements oi 
attendance which diffei from the attendance 
policy of the University, 

3. It IS expected that graded exam mat loiis- ami 
.papers will be provided to liie studem ft>r 

inspect mil and discussion - -I lius, final 
examinations will be retained fui one term tu 
provide the opportuiutv for review with the 
instructor, if the student so desire.s. It is expected 
that exaaiinatiuns will be giadcd wuhm' j. 
^ suffjcientl) appropriate time to make the 
examination a part of the sjudent's learning 
experience. 

4. All instruttioiial staff inembei.s arc expected tu 
meek their classes Regularly ^nd at scheduled 
iihies. In tase of illness or any othei emergency, 
the instructor will notify the department 
chairman so that appiopriate action may be 
taken. 

5. All instructional staff mem be is whose 
responsibilities involve students ar.e ^^x;pected to 
schedule a reasonable niimbei' of office hou^s fou 
student conferences. Office hours should be 
scheduled at times convenient to both students 
and instructors with the additional option of 
prearranged appoint men t.s for students when 
there is a schedule conflict. The number of office 
hours is to be determined at the appropriate 
administrative level, and office houis should be a 
matter of common knowledge 
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' 6. Instructional .stjff members who jre responsible 
^ for aCiidet^i^ic advising are expected to be in their 

office* at spgcified hours during the period of 
each eiirollnient. Arrangements will also be made 
^ for advising during registration, (pp. 59-60) 

MichigiHi State University is one of the institutions that 
has tried to^*improve instructional accountability, it has 
ij'stematicaliy ^expended resources to help its faculty meet 
their instructioiiiil obligations, bqth by employing 
discretionai?> funds lo develop an Officcf' of Educational 
Development, and by breaking the undergraduate program 
into some ^niull colleges. These efforts have not discouraged 
the legislature of Micliigtlu' from passing a statute, commonly 
referccd to as tlieC*Cj4L)ntact hour law" stipulating the hours per 
week a professor is to be engaged in activities directly related 
to instruction. 



Tools for Determining Expectations 

A number of procedures have been developed for helping 
clarifv wluit is expected of an institution of higlier education, 
and of the members of its,s,taff. The5e procedure:* may be 
viewed as special accountability tools. 

Survey techniques. In spite of a long history of use in 
many areas, survey technique's havp not been extensively used 
^until rather rccentl> in obtaining information relative to 
institutional expectancies, that is, in the gqals of colleges and. 
universities and the extent they have been or are being 
•ithiet^ed.' They still are not used extensively in establishing 
internal expectations. In J97I (}^0'^i reported a study that 
demonstrates the usefulness using go.ds in describing' 
universities. Both'tht^ procedures employed ind the results 
have implications to undeislandmg accountability .^Briejfly: 

1 . From an extensive literature seaich Gross developed a 
list of goal statements. 

2. These goal statements Were pretested with 
adniinistiators and faculty at a single university.'' 
Instructions were for faculty to report on what they 

. Saw at tlitiii muversity. Perceptions were asked for, 
no't opinions. From this pretesting, forty-seven goal 
statements U'ere selected,' whose standard deviation 
^ " on a 6-point scale was 1 or less. 

^ All of the administrators and 10 per cent ol* the 
. faculty at 68 institutions classified as univcr.sitjes 
were surveyed vvitli au iij.st rumen t containing these 
gTKil statement^ plus othe! questions (three hundred 
in all, requiring one and one half hours to (111 out). 
Instructions were for the respondents to indicate 



"how important is each 
''H\iw im'partan 
university?" (p. 25) 



aim at this unfversitv?" and 

H\iw impart ant should the 



ami be at this 



4. Apprc^imatley 51 per cent of the administrators and 
V 40 per cent of the faculty returned the instruments. 

5. Tests of sample bias did not reveal any^ bias in the 
^imepsions in ^kiclijlj^^^researcher was interested, 

"^OY interest to this review on accountability are these results. 

1. For college per^nrt|l^, the myst important goal, both 
perceived|and desired, was to *'^rotect tlip faculty's 
riglit to academic freedom" (p. 32). 

2. in the main, the 'impression was given that university 
personnel thouglft that not much^ attention jvas paid 
to students-or should be. ThA is, goals directly 
related to students were not highly rated (pp. 38-39). 

3. 'The most . neglected goal, one - that respondents 
7 * thought should have been considered important but 

was not, was to ".rnakc sure that salaiies, teaching 
^ assignments, and prerequiiiites always ^reflect the 
contribution that the person involved is making to 
the functioning of the university" (pp. 37-38}. 



4. 



Two aims that Were pcjiXiv^ 
emphasis than they , deserved 



:is receiving more 
ere. ''in.su re the 

favorable appraisal of thcjse who validate the quality 
of the progranis we offer," and "insure the oonii*"ied 
confidorice and support of those who contribute 
substantially to the finances and other material 
resource needs of the university" (p. 38). 



Ad niinistratioii and 
institutional goals;- 



faculty generally agreed on 



6. 



a^ai 



The more the [acuity of a V^rticular school. wa-: 
perceived as having influential power, to affect goals, 
the more tiiai .university was perceived as emphasizing 
that -students should develop their intellect and 
objectivity about themselves (p. 5 1 ). 



7. In institutions wlijjre the legislature or state 
government was seen as-having the power to intluence 
goals, the aims described in Slo. () were actually 
l>erceived as deenipliasized, * 

Generalizations from a single study are hazardous, but the 
implications of jthcse rcMrhs should not be overlooked. At the 
time of that study it could be inferred from the results that 
within the in.^titutions surveyed: 
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1. College personnel had not attended to goals that 
related' to studei^t attributes (Result No. 2). and had 
not viewed it important to be concerned about 

' external accounting, neither to their own accrediting 
agencies nor to their patrons (Result No. 4). 

2, College'^personnel were liot eoncerned about internal 
J* accodtitability and thought adaptations ^lould .be . 

,^ based on valid evidence (Result No.3). 

3- College' personnel placed more emphasis on 
^ maintainir\g llieir acad<?mic freedom (perhaps also 
institutional autonomy) than an> ' other outcome 
^ ' . f-Results No. J , No.^gLNo. 7). 

4 Faculty and administration presented a united fronf 
on goals (Result No.r5). v ' - 

5;. College personnel tho^ught their patrons and 
benetactors had different aims for the universitv than 
they XRejpJjr^Nd; ^ ' and made no attempts at . 
, , accommodation (Result No. 4)^ 

It is the lack of reai evidence Ss to how various groUps perceive 
institutional aims that suggests the . hecessitv for a survey 
Mmilar to tl($ one designed by Gross in, every college 
concerned with external, and to some extent, internal 
accountability. * ' *^ V 

Peterson ( 1973) recently completed a survey in California 
of 23.820 students, .faculty,* a"d m inisiratons, 
presidents-ghaU/cellors. governing board mem^bcrs. and' 
communii) people. Background lo the instmmen|aion used,, 
the Iminitional Goals Inventory (IGI), fnstitutionil/Rtsearch 
Program for-iiiglier Education. ETS, 1972) is\^ported. 
elsewhere by Peterson (1971). As in the Gioss (J 97 1 ) shiicy / 
Mipport or process goals as well as outcome goak w^e 
included in the instrumetttat'ion. Peterson also reques^d 
respondents to estimate both how important ea^^li goal was * 
and how important it should be. The IGI provides opportunity 
for aiding additional goal statements or background questions^ 
lo the regular format. 

Petejson reports more wide disagreement oii the 
individbal campuses :ind between campuses in California' tJian 
was shown by Gross, whose respondents were all from 
universities. People in the cojumunities near the institutions 
tended to rate **accountabilit>/efficieiicy" at about the same 
le\e! of desiiability as did college ""administrators, that is. 
slightly higher tlian faculties but below governing' boards. 
There were Qther notable discrepancies, e.g., faculties ratcsrf 
freedom higher in importance .iian did people of the 
communities. -^Iso students expressed iuuch more *|k»crepanc> ' 
between desired and existing achievement an "mdividual 
sludeni development'' than did the faculties. These arc 



ccrtami) not all rc^ultj> of tlie studv. The woik of b<5th Gios^ 
and Peterson denionstfau^that between vanous groups there 
.are sutTicient discrepancies regarding what is expected oi 
higliei education tu indicate conflicts of mtorest and bqur^^e.^ 
of discord for winch responsible adnnmbtrators mu:>t a^NUiue * 
the initiative in encouraging adaptive Responses. ' _ 

Delphi procedures. The Delphi Technique or Mcihod. 
including, Delphi Conferencing, may be a useful tool for 
identifying instructional expectations. Dalkey and Rourke 

_ (1971) have tested Delphi procedure^ in furmulatnig cntena 
aiul objectives in higher educat^n and 'found thom 
appropriate, The> m.iy be designed to roach tonsensus goals, 
or to develop a sirong set of pros and cons concerning a gi\en 
jssue. Huokfeldt (1972), working in the NCHEMS project at 

. VVICHE h'as U5ed Delphi t^ make forecasts about 
post -secondary education, Anderson (1970) reports the 
techniques weftf used hy the^ faculty in- the College 'of 
Education'at.Ohio St^te University as one strategy for helping 
to set goals and allocate resources. The^ School of bducation at 
the University of Virginia -employed Delphi t<jassei,s the needs, 
desires, and opinions of its clientele (Gyphert and Cant. 1971). 
Delphi procedures were employed durnig developmeni of the 
IGI (Peterson, 1971: Uhl, 1971). 

Turoff (1971) lists five situations where the Delphi, 
method clearly haylTn advantage over -uthor alternatives loi 
collating informed judgnien ts ( p. 3 1 7): 

Where the individuals needed to contnbute 
^ .knowledge to the examination of a complex pioblem 
have no history of adequate ctmimuiucation and the 
communication proj^css nia^t be stiUctuied to insure ^ 
understanding. 
\ ^ ' ' 

\ Where the problem is so bioad that more mdi\Kluais 
are need J than can meaningfuil> interact m a 
. face-to-face exchange. 

> 

Whrc diiagreements among individuals jre so severe 
that the communication process must be referecd. 

Where time is scarce for the individuals mvoived / 
anf*')r geographical distances. are_iaxge. thereby 
* ' inhibiting fnequcRt gioup meetings. \ i 

Where a supplemental group comnuinicatiu!^ piuce'ss - 
would be conducive to increasing the efficiency iSi 
the face-tc^face meeting. 

' r 

. These conditions seem descriptive of the situation in most 
colleges and universities. The Szd and cuniplcxity of the staff 
usually prohibits nieamngful dialogue in spite 4)f t4ic cxpci tisc 
and sincciity it^ medibers. Their time" as limited. 



Disagreements are apt to be severe and held ver> dccpl>. Kvcn 
where* the governance structure seenii. to.be functioning %ell, 
the Delphi can be a welqome supplement to a committee 
meeting. Delphi would seem to \)e particularly effective in 
alleviating st^)se probk^ms mostjiable to adversely effect 
committee decisions, namely: (I) ir.unipulation by the person 
who talks the most, is most skilled at small-group interaction, 
is most obsiinaje, or who is perceived as an authority. (2) lack 
of involvenieni by a sufficiently representative group; (3) 
.eluctance to' abandon a position that has 'been publicly 
expressed: (4) bandvvagon effects: (5) peer- pressure: or '(6) 
boredom frpirMxcessive unproductive Un>e. It also tends to 
hi^ve the effect of keeping discussion I'ocqscd on the issues and 
forcmg participants to sharpen their arguments if the> want to 
'make a point. The Delphi is described by Pfciffer (\96S, p. 
152-153) asfollowsf' 

Thc-vQrst questionnaire may call lor a list of c^Tnioiis 
involving expeiienced judgment, say a list of 
• predictions or recp/iiiiiended activitift. 

Oil the second Wind, each expeit receives a cop^ of 
ilie list and is asicfed to rate or evakuHe eacli itein by 
some such crtterion as importance, probability of 
success, and so on. 

" The third questioiUKiire includes the list of the 
ratings, indicates the consensus, if any. and m effect 
tiiks tlie experts either to revise their opinions or else 
to specify theii r^jasojis for remaining outside the 
consensus. 

*Th'e fourth ^questionnaire incliules list, ratihgs, and. 
consensus and, minority opfnions. It provides the final 
\ chance for revision of^opiii ions. 

. It IS feasible to operate a Delphi by i)iail, involve*. 
participai:ts,not usually considered in Jnstitutioivlil goal setting. 
. and, treat data from different groups separately. The latter 
woiijd have fne advantage of permitting planners to know 
which groups had similar or different goal values and IQ engage 
in "public relations'' or educational efforts to.cliange opinions' 
when deemed desirablc-or necessary. It can be used to get the 
public "in at the beginning" instdad^of treating patrons and 
clients as though their opinions were of no value. rc{)ortmg to 
tjpem after-the-fact or trying to hide adverse but important 
yifoTniation from them. 

Three cautions to using the Delphi'should be noted. First 
of all, the possibility for renecting extreme positions of 
opinion should' be maintained \lirougliout successive 
administrations of the instrument. That fel item,s should not be 
eliminated because of a low number' of responses! If the 
opportunity for divergent responses is reduced, persons at the 



extremes will tend to drop out of the study and the result^ vvill 
reflect a false Lunvcrgence. Secondly ,*durmg the tune it^ldke> 
to cofiiplete the Delphi, conditions can so change that the 
results are irrelevant. For example, during the past fom vejrs 
many small colleges have suddenly shifted ilieir busiL mibivj^n 
from tr^inin^ teachers to $omc other focus as a rellection ot 
the job market. The results from a Delphi completed two>edr5 
ago niigfit thus lack currency. Third, the statements must be as 
unambiguous as possible. Sometmies wjiat niii^ appear as lack 
of consensus is really lack of .understanding of the statement. 

Employment contracts.' Employ nient contracts based on 
performance have met with various degrees of success, at 
elementary and secondary levels. In at Jea^i one instance, 
.Passaic County Community College, they weie -exammed for 
use at the community college level. As currently proposed, 
they do not seem applicable a^ the college level except in a 
restricted sense, e.g., a college might agree to provide iraiiiiiig 
to a certain number of « elementary school mathemaiies 
teachers for a stipulated price. The "Sample Enjploymeni 
Coiiiraci" shown in tile book by Roueclie and Pitman (19^2) " 
is probably characiensiic of others. The following quote may 
be sufficient to provide the "flavor'' of the obhgaiions 
5tipuiated (p. \^): * 

The follo\\^ng criteria \)f efficiency are 
preiequisite for tterank of full professor: 

"*\* 

(a) 'The full professor will fvo responsible for 
designing, iniplenieniing\ managing and 
evaluating learmn^ experiences for a nfinimum of 
960 Student credit hours pec semester. 

(b) At least 9p peicent of the students enioiied in 
the full professor Sr classes at the* time of. 
registration shall achieve stated, objectives at u 
level^ satisfactorj' for transfer to a . senior 
institution if in a transfer course, oc at a level* 
sa tisfactory ' for ejiiploy-ment^ if in an 
occupational course. 

Furthermore: 

(a) A /acuity member in any rank may qualify for or 
attain any higher rank< following any three 
academic years of pprfornuince at the higher, 
level. 

(b) A reduction in rank for inefficiency will occur 
, ^ after jhree (3) consecutive years wherein the 

I criteria for a given rank are not met; in the .case 

of the instructor rank, the indiVKluaf will be 
dismissed for inefficiency. ' 



such cmpioNineiU contracts arc currently perceived 
bv academics as iniinical to a goo.d teachmg cniplo> niciu. Such 
conditions may also increase the Inireaacrailc nature of 
colleges and universities,' . ' . • 

Charters of accountability. Charters of accountability ina\ 
be perceived !i3 a tool for internal ^iccountabillty that ^niglu 
improve the^ c^.:pacity of the institution for external 
accounting. The tool is slescribcd Scheid ( l%5) in relation 
to the coivniunicated purposes and objectives of -^i company 
and by" lope/ (1970) in relation to education. Scheid is 
adamant that accountability can be delegated quite preciseK . 
that functional perform;|ncc can be measured and tiiat these 
measurements can be eniployed for making evaluation (oi 
:^ccouiHability'U4**4p'^^^^^ls. K would certainly impact 
eduiration if f^no omer "i^easons than that it rcqui>es-(l) 
specificatfon^f overall institution purposes. (2) disclosure of 
miportant objectives. (3) a list of what obligations 'must be 
met. atid {^)^authorizatidn to perform or to obtain the 
wherewithal to do so. These last three*' conditions have not 
characterized university accountability transactions..While the 
charter is an agreeni**nt betwe$?n two individuals or groups, one 
supcroidinate and the other subordinate, both parties are 
completely involved in consultation, negotiation, and 
discussion. Scheid reportsMhat ..individuals respond more 
app\ii£i:iCtely and willingly to objective evaluation of t^eir 
pertbiniancc than to subjective trait appiaibal" (p. 92,). 

Tlie piinlary lienciency in both employment contracts 
and charters of accountability as i^ieujis for clarifying what 
should be expected of a professor is\ihat they imply a 
governance siriicture " involving :/ bureaucratic ot 
superordmatc-subordinate relationsWp. li\Mh Gross ( 1971 ) and 
Hmd (1971) have .suggested that the governance structure iU 
college.^ and universities is more poiitica! and associative tiian 
bureaucratic or authoritarian.. 

Collective bargaining. ObviousK Keck (1972) does not 
perceive college govenumce .as associative, lie effectively 
argues that collective bargaining is a consequence of traditional 
faculty agencies becoming ineffective in tffe face of 
burcauciatic decision making by oiganizational managers. He 
thinks it is now necessary for the ^\ . . illusion of independent 
professional entrepreneur. . to be cast aside . . within an 
•institutional framework that is organize-d-rfiuTrun according to 
jhe principles of industrial management" (p. 51). lie sees few 
budget decisions as emanating from the department level, a 
senate or council as having no legal basis, and consequent!) " 
being ineffective: the AAUP as being almost as inadequate, and 
the industrially oiiented universit) management as . . not 
susceptible to moral suasion" (p 52). 

Th%" managerial bureaucracy is immune to pleas 
of humanity., decency, democracy, or academic 
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tiecJom. It li equalK nmnuiic to .sanctions ihai aa* 
not backed by the power of cnfoicement. Univeisit\ 
management is well a\y^ that the gen^ni public 
^ couldn't care less aboiit wljat the .AAlJlMor any uthei 
organization) thinks of Ihis or that umversity. The\ 
also kium lhai,gi\en ilie present coiuhiioi ih j'>b 
market, protebsional sanctions vannot huit ^hem, tp. 
.52) - 

Whether collective bacgannng. '\ . . a sy:st. n ut ^liaicd 
authontv based on a process* of bilateral de» ^ion i laknig 
j)etween two ageilts. . . utih/jng Icgalh-estabhsl d procvdures 
for reaching mutual agreement" (KecL |'x 52k will pune a 
useful means okestabhilimgobligatioiibiemams, at thih ,inie. a 
moof point. If the tiend persist:> on the pait <A Kuultio to 
suppoit the concept of collective bargaining, then the pohhcal 
modef as perceived In Bakiridge (19-71) will iia\e oiil\ limited 
applicabilitv, for example, during the time when basic 
obligations tor which the agent i:s >u negohate ate being 
decided. The model of the universitN as a buicaucracv will he 
enhanced, although the/ concept uf the uni\crsit> as an 
industry producing a ^pecifk piuduct dok^sjiot seem tcasible. 
^Contracts will prubabiy focus h\\ actiyiies^ *»1 the taculty 
rather than outcomes. ♦ * 

Task analysis procedures. Over the past tw o \ cais C.uk et 
al., (1972) lijvc been engaged m a study to anaiy.c and 
describe centers engaged in researcii. development, dfffusion. 
and evaluation (RDDH). While the* proCeduJcs dcwelopcd to 
conduct that anahsis i],i\e had only nnnimal appl^auun m 
higher education, [he\ appeal to offer a means of meeting 
some of the anxieties <,rcatcd b\ suggestions foi mipiuxjng^ 
accountability and some of tlio dehviencits vjf other Ijcuhv 
activity analvsis proceduie^ tRumnev. 1971). FhoNe icai'- 
expressed b\ acadv^mics tluU tiicn must inipoitant but subtle 
production may be umecogni/cd, nj thai ihe\ m,i\- be [udiied 
on (he basis of inappropriate cntchia and standauls, aie dealt 
With diiectly bv tiipse analvsus piuceduie^. 
% 

The piocedures requiie a iiev. conceptuah/aOon <^\ 
output. Output IS the designation applied tu whaievcr an 
individual prucluces, whether it js a pruOuci (a book'), c\enl 
(an interview), oi a condition Uuutual respect). Iiiipiemcnting 
the piocedures usuall) requires the examination "ol artifacts, 
Mnd talks with executive adnunistratuis, an outside agent \\t. 
an internal agent whose insiitutional niTssion includes such 
activities) develops a set of guidelines as tu who sliouid be 
interviewed and what questiutis should be asked, Inici^'iews 
are then conducted by means of a *1ead and piube" slrategy 
providing e.icb person oppoitumty to describe then outputs, 
to decide what evidence indicates quality petformance. and to 
'suggesU standards for judging. Descriptions piepared by the 
' interviewer are subnntted (o the individual to inuire that 
agreement is reached that h1^ outputs and the siandards lot 



judiyng llicni iirc adequately described. 

-from these interviews output: of the uisUtution tan be 
c,onii>ared to outputs of services within the uistitutionMo see if 
the latter are contributing^ to the former. In most colleges and 
universities there will be independent and, perhaps, even 
incompatible objective^ (outputs). This conditi^m may be 
perceived as desirable (Brandl. 1970), 

Instruction is an obligatory relationship. The 
administration of a collego or univ^rsit) , the Lunstituencies of 
the institution, and the^members of the teaching and support 
staffs, all have perceptions as to what is expected of each other 
and of tl>emselves. The relationship would be improved if 
those involved could do one or both of ^wo tilings. (I) agree 
on what obligations each has toward the others in 
miplementing tlie lUbtruttional program of the institution, (2) 
establish a means of accounting to^ each other/, of 
comnuiiiiLatiiig to ime another about what they are doing, llie 
apparent effects of what tliey are doing, and their judgments 
as to how'mhers involved are fulfilling what had been 
expected of them. Ui turn, accounting permrts expectations to 
be clarified and reduces conflicts resulting from 
mlsunderstanding^. 

Obtaining and Disseminating Information 

A cartoon b> Lichty, "Gnn and Bear It/* pictures a group 
of corporation executives in a conference session. The caption 
has tjic cliaiinian saying, ^'Since tjie activities of this companv 
are a matter of public record, the purpose' of this meeting is to 
devise means of covering our tracks m the future!'* 

^Lidu> seems to have captured the essence i)f what the 
current emphasis on accountability is trying tt) avoid. Current 
cnipha.sis ui^accountability mjciiis to be toward developing such 
information as is nece.s.sary to enable the agents and agencies 
involved to. ( I) know what can be expected of eacli other and 
(2) have ^onie evidence as lo how well those expectations are 
being met. In brief, the contklence that can be placed in the 
validily, iccuracy and adequacy of available uitormatiou l^ the 
core of viable accountability. 

There are a variety of barriers to developing adequate 
intoimatii)n» I irst of all, external demands for information 
obviou.Nly threaten the rights of an institution to autonomy, 
riifoiighout an examination of external accountability, the 
question of the right of colleges to .self-determination regarding 
responsibilities and di.sclosure of information must be examined 
in light of how institutions and then clients and pationscan be 
expected to respond to suclr autonomy. Autonomy is a 
relative value. It varies considerably among institutions. It also 
varies from one geographic region to another,. 



f Unfortunately the arguments about .wanting to protect 
aifionomy are not vdry convincing. There* are too many 
examples of jjolleges sacrificing autonomy for other gains. 
Acceptance of categorical federal aid, basing rnent» pronioluni, 
and tenure' on standard's prescribed by profes.sional 
organizations of the disciplines, employing .state police to 
control campus conflicts, and seeking court action in 
* ' personnel disputes "have . seriously weakenejtl arguments 
supporting institutional autonomy. TcO the cynical, the 
willingness of institutions, and their agencies and agents, to 
accept donations to which are attached stipulations regaidiiig 
tlicir use is sufficient evidence that autonomy has always been 
a virtue iO be suld-or at least employed in bargaining. 

The primary* arguments opposing changes in internal 
accountability are apt to center on threats accountability is 
perceived as posing to faculty academic freeduin. Although 
academi6 freedom is not defined as clearly . as it might be, its 
ij^ipoitance varies Tcss betw'een schools than does autonomy, 
and it is apparently a liigiil^ valued educational goal (Gioss. 
1971 and Peterson, 1973), 

Proposed changes in accountability should avoid 
weakening academic^ freedom. A worthwhile goal of 
accountability could be to strengthen that freedom. But 
opposing accountability **on principle'* is a posture that 
endangers academic freedom. Opponents to change in 
accotintability *should be encouraged to develop their 
opposition nationally and thoroughly. The best defense against 
infringing on others* lights is to be sensitive to those riglit.s jnd 
to provide every available means for theii adequate delenbc. 

A third barrier to developing adequate mlormatfon is the 
Hiadecjuacy of procedures for assessm(hlt. It is difficult to 
judge Ivnv realistic expressions of concern about, invalid and 
inaccurate assessment are. Brown (1970) has suggested that 
coifiproinisc is essential, that most' measures are really 
"proxies." *Mf proxies operationally issist resource allocation, 
. if decisioiT-making is better with t) e proAies than without, iLl^ 
alonb is justification fur their ad'jptioj,* (p. 29). Brown groups 
proxies as inpu^ output, v^r valtie added. Of course the mu^t 
meaningful proxies are those that nWasure change, but If tlu >e 
are not available, he lecommends employing second best. 

At "the WICHE conference both Enthovan (1970) and 
Brandl (1970) were cautious in their predictions that anything 
but the most crude indices of educational effectiveness wuuld 
be founi Enthovan suggested three uses to be madt? of output 
measure Ajp. 51): ^ 

L |jdes m allocation decisions within the Tiniveisitv , 

fi 

2. aids in broader allocation decisions between higher 
education and other public piograms, 



;>. jui.s in ovMliialiiig ilio eiYecn\enci» of dilTorcnt 
teachers, leachuia niethoilsror curricula. 

? 

Ho fioiiited out thai measures for one i^urposc will probably 
ihii /h' ihc Sijmcas thosi' Jor anollur purpose ami that we ma\ 
nor even hawe a way of relating them to each other. The 
Higgebijon IS ihai. "Because there imio agreenieni on piirpo.ses 
ui oil relative values, there is no 'optuiiuni* program for the 
uni\efsrt>. There arc only better and vvor^e program^. 
Avoiding bad programs is a sufficiently ambitious goai to keep 
us all occupied (\)r many yearsr" (p. 53). The motto is. "it i 
boiiei to be routjhly right than prcctscl) wronc" (p. 53), 

It is possible that part of the concern about Information 
obtained 41s a consequence of assessment stem, from an^icjiv 
that measurement may be too accurate and vahu. That is. feai 
that assessment niay icsult In disclosure of weakness ma\ be 
increased as the validity of the assessment g^ocedurc increases. 
To the extent that information is seen as being used for 
leiribution rather tlvan improvement of nistruciion. the 
anxiety IS explainable. 

One of the most ditficult barrier^ tu penetrate is the one 
laised by those colleges, prograjsis and professors that say," 
"What we produce cannot really be measured." The possibility 
that outputs will be viewedjoo narrowly, that subtle effects 
Will be overlooked, must be . reduced. There are some 
oxtret^ieK difficult measurement problems, Bui. in the main, if 
soniethin^has not been measured it is usually bec;iusc jt has 
not bceiOhought that measuring it was important. Whenever 
college personnel consider it essential that their outputs be 
measured. for_ example should thc\ become dissatisfied with 
unsystematic and invalid appraisals of teaching, then teaching 
Will be measured. The current, l^tck of concern abom such 
measurement is primarily because teaching pcrfocmance is not 
a factor in- determining the reward structuic ol** the college 
(llind. 1970). 

Mager (l%8) has an unsympathetic response to those 
who are defensive about having outputs assessed (p. 69). 

"You can't^measure the effects of what 1 do." 

'AVhy not?" 
"They're intangible/* 

"Oht Why should 1 pay yOu for mtangible 
results?'* ♦ 

Because I've been trained and licensed to 
practice." 

"Hmm . . . all right, llere'syoui money " 
"Where *^ 1 don't see it.** 

*t)f course not . . . it*s intangible." * 

t 
I 

Detcnsivcness. is justified, and should be encouraged* when^ 
there has been no prior agracinent on goals, on what wmH be 



accepted'.is c\}dc>>^o 0} uutpui. 01 the u^c^ u> hc^madv of si^h 
inlbrmalioiK ' 



Providing Jnform^fon for External Accountability 

[ The admnlistratoi %iiiusi take th.e initiative in making 
\ntclhgont responses related tu .iLLOUiitabilit> . Not all demands 

Informalion should be .mswered'b> supplying u. Not »ll^ 
tiiloi'mafiun should be disclosed. Di.sLlosure should frcquciiily 
precede demand. \\ requires some seiis'tivity to the needs ot 
others, and .1 piofession.d b.isis for sclecuiig alternatives tor an 
administratoi to know what i"espOi\ses to mate m tciii'is 01 
supplying information. Some ndoimatiun should be supplied 
on demand whencvei possiblcyc Some legitimate needs fou 
fnformaliun^ that would be ^ useful m meetn§ bollr 
requirements for nuerr.al m.in.igcmcm and external 
.iCLoujiting. and wliiLh Lould be LollcLtcd .aid stored in 
anticipation of need*. Attempts to obtam .nid employ such 
data^ in educational management have met with less than 
outstanding success, partly because of inability to identify and 
assess valid value-added measuies'of outputs, parth because 
instimtioiis' of lughe^ education app.ircnti) do noi have the 
oiganixatiujial struttures to suppm^exten^ive d.aa Lollection. 
and paitly bcL.iuse many auniniistraturs remain uii^^oiivinLcJ 
of the value pf their use. In the mani. colleges have been 
apathetiL. .md at tmics dchberatciv rcsist.int. to obtaining and 
reporting accouniabihtv inloriiiation 

Gi.iLS ( 19'?2| offers .iu eXveilcni gu»de lo detenniiie what 
categories vjf nit'oimalioii might be as^os%ed .nid lepoitcd fui 
external .iCLuuntnig. While tlic iullowing \{A \s nut exhaustive, 
it iliustrates'^Llasse.s of inlurniation for c^uh o! the ^atcgiJiic^ 
Glass proposes. 

1. In relation loourriculum. 

a. A siaiement of the mission of the ln^utut>ou^ 
that points out the desirabiiilv of .i vancty ol 
goals, and review^ Uiosc that .ire contiadictiay 
and those that are compatible 

5. Descriptions of each program, course, or 
sequence of stucly< including expectancy jables 
re In ting en try data to expected level of 
performance. 

e. A statement of pohcv dcscnbum how decisions 
are made for purchasing instructional materials 

d. A description of the programs for encouraging 
supeiior instruction andA>r impioving intciioi 
instruction. 



e. A record of the number of leachiiig hours 
profe''ssors have iuissed aiid the reasons for these 
absences. 

f: The number of student hours tauglu at various 

levels by professors with various Jevels of 

training. ' ^ 
* ft 

g. For programs that are pre-professional or 
. vocational in nature, the' latest information 

related to education and employment 
. opportuiiities. ^ ^ , 

h. Student evaiuattons of courses and instructors. 
I. Estimates of the ad^quncy of library holdings. 

In relation to studeiit growth and >velM)enig. ^ 

a. Studies on campus *climate/ 

h\ Reports on the activities of pupil personnel 
services. 

c Rrjords of studLlU^i enternig. grades received > 
student progress through college. 

d. Information on follov ip studies of^graduates. 

c. Information ji» to whv students drop out of 
school. 

In relation to personnel: 

a. Prtxrcdures'foir selecting staff. 

b. Pioccdures for cyaiuating instrucnona! 
competence.- ^ . 

c. Procedures for dismissal. * 

o 

d. Benefits, e.g., retirement and sick kave pohcses. 
In relation to finances;* 

a. . Credii'hour costs in programs and courses. 

including any s|)ecial fees and how the> are 
spcni. 

b. Procedures for letting contracts. 

c. Uses' made of discretionary funds. 

d. Sources of funds. # ^ 



e. Cost for a student to go through a progrnm 

r Costs of support services 

^ g. Building plans (shoulii be included in 
Goininunity Planning Committee reports) 

5. In relation to legal obligaiions: 

a. Age. race, sex. rank, and salary of all staff. 

b. Policies related .to the discipline of stuQents. 

c. Procedures by which money is collected from 
students. 

This infonnation could be collected and processed 
iMternall). All of these activities can be monitored b> an agent 
external to the institution and a report of that monitoring 
made public. It would provide disclosure that is candid and 
likely to b^ well receive^ by consiituencies. If this information 
is not available, that m itself reveals deficiencies in 
accountability: The primary reason for fearing such accounting 
IS that it may both encourage -and allow for external control^ 
tiut IS, Its Jvailabilty jnav threaten autonomy. This study did 
not disclose information as to the extent the availability of 
information resulted in its being used by outside agencies in 
ways inimical to the welfare of the institution. 

Developing information in such categories is procedurally 
not unlike that of accreditation. Accreditation iias tended to 
fail into^ disrepute because ^the judges have been closely allied 
with the establishment. Accreditation agencies also reduce an 
institution 's autonomy. An institution that conducts its own 
appraisal, has that effort independently audited, reports areas 
of satisfactory and unsatisfactory attainment, and publici/.es 
intents to niijkc changes, may establish' credibilit) with rts 
constituencies that justifies maintaining autonomy. 

One of the tiiore sensitive problems concerning public 
disclosures of inforniation relates to issues of confidentiality. 
Arnold (1972) has written a position paper on the inHucnces 

"full disclosure** in whiclu she suggests that it seems 
traditional for citi/.ens in the United States to assume public 
right to information and to examination of government. She 
v/rites that Americans today demand and receive iufojmation 
abou. the costs and conduct of inan\ government programs, 
th.at this information bears on choices they make, and that 
ed':cators should be checied by this new awareness as these 
demands are turned H) requests foi information about the 
costs and conduct of iugher education. Although the accuracy 
of this perception is que.'itionable. Arnold has raised an issue 
worth commenting on. 



Computer technology may faciliute responsiveness to' 
demands tor c?^tcrnal accountabjlitv. M:isses of data can he 
stored in a variety of ways to meet various retrieval necd:>. The 
combination of increased demand for disclosure and increai>ed 
capacit) for responding to demands for disclosure ma\ 
endanger institutional autonomy, and academic and perM>nal 
freedom. There are no precedents m education to suggest that 
pledges^)f confidentiality regarding |\e^onal and personnef 
matteis can be given with assurance tl>al they will be kept'. 
Pnviicged comnmnjcation has not been extended to the 
relationships between college persnnel and their clients and 
patrons. However^ it is technically possible and practically, 
feasible to piovide 'blind repositories' ^vhere sensitive data 
contam no names, only code numbers, with ke\ to matching 
nuhibers and names located outside of tiie United Slates and 
which cannot be subpoenaed. 

But most public demand tor disclosure is not related to 
student or faculty personnel transact fjons of a personal nature, 
lliev ^re related to outputs of the utiiversit^ and the costs of 
achieving them, or to mformation about kinds of programs 
otTered. Colleges do not have a history of candor m relation to 
public information. This may account for the creation in some 
states of governing councils in place of coordinatmg coifncils* 

Dissemmation of data is ^sential aecouniabilit) . 
Adaptations cannot be made unless inforniatioius shared. Twtj 



certain ways of weakenuig accouniabijbiv,..^ to {If conduct 
thorough and intensive assessments ^id tiien not repoit the 
results of thai assessment or (2) disseminate systemu'tically 
obtained information that is never acied'upon. 

X 

Plans tor diss^nunaiion should be developed as other 
changes are planned. Who should collect data? Process it? 
Distribute it? Have access to ii'^' These questions must be 
addressed and tiie* answers made part of the available 
int\>rmaiiun before changes in accounting are mif^emented. 
( r edibility • is damaged with- one's const luIenuiT^ if they 
become aware of deliberate attempts to hidc'mimj^i^^i that 
ihe\ considei should be made publicly available. But while 
candor is critical in disclosure, not all information should be 
made public knowledge. A professor's raili^g^n a teachip.g 
pert'ormaiK^ appraisal conducted by his colleagues is 
sumcwhat analogous to one's s(;ore on a test of intelligence. 
The data should not be disseminated to those who cannwt 
understand it, nor should thev be utilized in contexts where it 
'was not in ten d^^' they be employed. 

Experienced administrators are aware of the kinds of 
information that will be requested b> their state legislatures 
and its committees. As Gage (1070b) has indicated^ when da?a 
needs can be anticipated^ an institution can demonstrate 
icsponsivenehs by having mfoimation available un call College 



admunstralors can usualix mkv the imiiali\e m su*.l» 
disclosures, although the creation ol goverjurij; mjaids laiher 
than coordinating boaui^ s{»g»:csis that m some states ihou 
ie|)oft^ were no kmgoi ..icdible. Glenny (1971 ) ]ia,s Je.scnhed 
the hazards ol"*acaUng boards with msuflkient powei to 
protect the publn. \s, agencies with power that ihieatcns 
institutional autonomv and initiative. 



Providing Information for Internal Accountability 

In this repvti tiie basic cuuct rn is instruciiona! 
accounlabilit). It is difficult to aLlneve extetnal acLOUntabiht\ 
m the absence of effective intemai accouiUabiiit\ . paiiKularlv 
in rogard to instruction. While .some data aie useful foi both 
external and inieinal ac<;(^unimg purposes, information related 
to the teaching performance of individual piofassors probabK 
has more internal than extcfnid value 

ObvioiisK the *.iitical issue m asses:>mg iiiMiuctiOn wiihm 
the univ^ersilv is the difficult) of developing suiiahie 
assessment procedures that will meet cssennal mca.^UlC^lelli 
standards, Perh aps the best ot the more current publicaluins 
integrating the theoretical und piactical piublcms relating to 
assessing tcachmg etTectnenoss ih iliat hv Ri^nai] (P^*^l|. In 
this document it seelns sufficient lo sa\ that, ai 4iie college 
lc\'eK assessment instuictiun invoKes few thcoielicai Jssue^ 
different fiom teaching at uthcr ic\c]s. It dues nauKe suiiic 
j)ractical problems that are more uuticLjhJc m the .)^au«..iiic 
world. 

Ihcic seems ttJ nc coi^sidcrable consensus jmi^m^ (huse 
who^iave studied pri/nlcms ol leaehmg eirecti\enes,s ihat tijo 
abiliiv tt> msiiact Us not a umiai) nait Ti'c V.aiitjup m lescj'ui^ 
on teaching effccnveness iia'- hecii ( h the St^hfliiv U) 
esiablisfi acceptable ciitena of student poitiMmancc."^l||d 
the mabilii\ lo correlaic teadicr pcji^^^nanct dud siuuetii 
performance, JuMiz i 1^^09), m an c\ceile;HK desii^ncd stiul;. .u 
'sccondar\ level teachnigjias shown thai * % 

1 . Pupil p e r f t) r ui a u c c vui a d e q u a t e I v do \di >pc d * 
examinations, can he used to measuic t cache i 
effectiveness. 

ft. 

2. General ;eaciniig abilu> (GTAh can ^bc lehablv 
measuieu in terms ol pupii acliievemcni (»IA is 
. . , "That abihiv which th-' teachjcr brings the 
tcachmg situation other than know^dge oi .subject 

matter*' (p 54) 

3. Pupil aclnevcniciit can be used to ideniih picdictots 
of teaching effectivenss 

^ LxpViimentation wiiii pioccduics and vaiialilcs .siinilai to 



ERLC 



ihose einplovcd in Justi/ wo'uld seem UbCfii! ai ihc college 
level Tim IS, it would be worth trying lo separuic GTA from 
utlier vari«)bks; however, the probabilit) in low that professors 
would perniil Justiz's procedures, of having teachers teadi 
**u«familiar'\ material, to be used in a college setting, 
fcisiablishing some criteria based on student performance 
would pej-mit testing the validity of process criteria and trail 
criteria. 



Whdc professors expreb> intcrejvi in jnNtri.<.Hoii atid tluiik 
teaching i>hou}d receive iiicreasgd enfphaM.s m deter mimtk 
rewards (fiind, 197L Hildebrand/l97!X, the) do not want u* 
reduce the time spent in re^earJi and scholarship (Hiad. 
1971). Hind suggests that professors may have a conflict of 
values and that t^ j arc already devotnig more effori /ihan 
would be predicted Jo tasks (teaching) that haven't inuvh 
influence on how they^arc rewaided. 



The results of the Oregon Studies by CarL et al. (I97j)^ 
and the preliminary 'work by Manning (1073) suggest that 
professors, can and should be involved in detejmining a variety 
of instructional outputs. Analyzing these outputs to determine 
th-cir relationship to student outputs is a difficult, but not 
insurmountable, research problem (Turner. 1972). While little 
research hasM)een attempted in employing the Carl RDD&E 
model 10 establish standards for judging outputs, the 
procedure would appear on the surface to have as much 
validity as faculty activity analysis, at its cuitent stage of 
development, in obtainitig output criteria for analyzing 
internal accountability, particularly in determining standards. 
Both procedures need further study in terms of: (1) faculty 
^iece^;;i«^s^|2)^_^^ is niost amenable to 

Mjij^lcnii^ai'to^^ the most valid results, and 

(4) ^^Jj^c^Xs mo^ ecoh<4imcal\) implement. It is in researching 
l^ablishmgj criteria of torching effectiveness that the 
part'icular idiosy^'cracies of "college personnel become most 
inhibitory to adequate assessment. Stake'.s (1971) suggestion 
that individual professors be permitted to establish their own 
criteria has apparently not been explored. 

In the absence of acceptable criteria for assessing 
ii....uciion. many colleges employ other criteria for 
determining justification of merit, promotion or tenure 
(rewards). In larger universities research productivity and mher 
evidence of scholarship are employed in such valuations. This 
in effect has the frequent consequence-of having the judgment 
regarding''quality of scholarship made by persons outside the 
institution, e.g., the leviewing committee of a journal. Within 
ttic institution^ the judgment may be based on^ counting 
(Gustadv 1%7). Many colleges and universities reward activity - 
on conifHittees. particularly tho.se Involved^ in academi?: 
governance. 

WlrTtTTTV^s accept5ij)le to' employ criteria such as des'cribed 
in the preceaing paragraph for hiaking decisions related to , ^ 
distribi^iTTolr^f regards, it is not valid^to employ them as 
^though Ihey wefe\indicators of teachmV^r/ormance. The''^ 
extent they used in a decision to reward a faculty member 
is an indication of how valuable they aie considered to be. that 
is. they may be more or less important than teaching. Such 
evidence .sjiould not be currently cousideied any morc^ than^ 
superficially related to one's comfkMence as an instiuctor. 



,> By far the most prevalent obligation lard on most 
prof(>ssors is that th(^> must tea'ch. ignoring (hii> obligation can 
"geupne fired, eveijjfiiiltdliiig it duCMi't result m proniutlun oi 
other reward. F^ar\ tif jfie lack^. of emphasis on nnprovmg 
college teaching is tecauMj the faculty, who really, cgntiol tlie 
system of rewards, are apparently not sufficiently dissatisfied 
with minimum acceptable leve):> of teaching pcfformancc lo 
overcome inertia and work foi miproveiiient. 

The following obscrvatio.n.^ are suggested with "tongue in 
cheek" a¥a meahsof dramatizing what imghi be anticipated to 
occur if professors valued mstructiott. 

1. reward systems. Jwould be based prinianly on 
demonstrated performance related to inbtruction, 

V 

2. faculty would be earnestly involved in institiHional 
goal setting and prioritizing around a nn^^on of 
teach.ing: 

-i 

t - ' * 

3. a sizeable portion ofMhe insfitutionat budget vvould 
be spent f)n 'efforts to improve msi ruction: 

4. p rofessors' v^ho. exhibited 'MioncompliaiA 
cpmphancc*' (.Miller. 1^72. p, 19) toward evaluation ^ 

- of their teaching would feel sonie evidc'nce oi peer 
group dissatisfaction; ' 

5. prospective employees vvould inquue about cla^sb 
sizes, -library facilities, availabihtv oh^nslrticti6iul 
support services,' the instifutioiial program tor 
impro.ing instruction, dulj^inientarion of criieria.and 
proceduLi^J&ir-^valiiating i.iSfruction! research tvv 
campus directed a I col lege -level instruction, th(f^typ<?,* 
of student personner services in operation.. and the 
Avork being done by the -test cenk^r bcftue-accepniig. 

. ' an appointment: \ ^ > ^ 

6. * legLslatuiGs vvould pass st^itut^o limiting the number 

of luMir.s a professor could spend, teaching- and 
prcsjcrlbing thetiriTe that \w\\\\ be devuied to re^seaicli/ 
gave?iiance and servide!* 

* Procedures for judging teaclwng effeetive/iess. StiHcr 



( 1^)7 2f describes five procedures for evaluanng ^classroom 
leaching: (i) siudcnt evaluation, (2) classiooni visilauon by 
colleague^/ (3) examination of a\iclinig materials and 
procedures, (4) vveig^n''ng special incidents (includes evidences 
^of good 01 bad teaching not found elsewhere), and (5) 
^elf.ev3luation. Mis book^contains simple descriptions of 
procedures and instruments used in assessment. Regardless of 
th.e procedures uscd< iMillcr is adamant that: ( 1)- evaluation of 
leaching should be only part of the overall evaluation of a 
faailiy member's professional compeience: (2) institutional' 
goal setting "must b'/aaken more seriously if faculty evaluation 
IS to be tied to goals: (3) department chairmen and deans must 
he actively* involved; (4) the processes must be systematic, 
manageable, and economic: (5) the system s!iould be used 
positively. In this study there w5s little evidence uncovered to 
suggest thai assc^sihent of instruction was used extensively in 
the way that is frequently suggested as th'e^prmiary reason for 
such evaluation, that is toward impiovement of instruction, 
grom the meager responses to 4he questionnaire submitted, 
there is also an in(Rcation that: (1) few colleges have taken 
goal settmg seriously, (2) the processes for evaluating 
instruction are'seldom very systematic. 

Michigan State Uniyersitv has been cited previously (p. 
1 1) as one school that has employed discretionary resources in 
attempting to improve instruction. (See\also a comment oii 
MSU's student evaluation' scale, fy] 1.1). second ujiiversity 
that appMrs to have implemented procedures for judging 
teach in^ effectiveness is Colorado State University 
(.Comments, March 29 and .April 5, 1973: Office of 
instructional Development, 1973). Each faculty member is 
encouragedjo emplov a minimum of three means of collecting 
data about his teaching (Comme/z/s. 3/29/73. pp. 2 and 3). 

L obtaining reactions of presently enrolled students 
through the use of the ASCSU course profile; 

2. making an audio tape of classes for subsequent 
review; 

3. making a video tape of one or more classes . . , and 
having the tapes critiqued by the office of 
instructional development ; 

4. aomimstering pre- and post-tests to assess student 
gains in achievement; / 

5. asking departmental peers to 'sit in' on several classes 
and give their reactions to what they observed; 

6. following up the progress of students in suLscquent 
courses when prerequisite courses are taught: 

7. contacting students Matter they have graduated to 



obtain \\w\i opihions .ibotj/^oaciung ctlectivchosN, 

8. cont.jccing l^iployer^ wheie ^appropriate about the 
pert'ormance of lormer students on then jobs. 

9 inviimg the depaitment iiead oi dean to visu cia^^sc^* 
and mve su<iuestK)nj>: 

/ ' 

10. tornnng a special ad\Ksor> pane! of a lew nitcrested 
students in each cla^s and nieetnig witli them once a 
week to obtam suggestions: ^ 

11. subnntting' course uutlmes, ' syllabi, test^. etc"., to 
professional associations oi othei quajified groups for 

< review ;uid critiquf . 

The Acadenijc Vice President goes on to suggest. ^ 

hvcry faculty member should engage in at least titrce ol 
the foilovying development activities each ^eai, 

1. attending special teaching seminars and leaclim^ 
improvenien uprograms; 

2. reviewing the hteratuie on teathing niethudoiogy ui 
.the field to obtam new ideas to[ teaching the subject 
matter: 

3. conductjng cxpernnentvs to deteiminc whetliei ne^ 
techniques are suitable for permanent incorporation 
ip*o one's teaching repertoiie: 

4. team teaching with a highl) respected colleague and 
obtainiPig suggestions from this persoti; and 

5. exchanging classroom visitations with respected 
. . colleagues in nearby colleges and universities. 

it is the author's understanding that this siatemei>t has bcin 
approved by th.v /acuity as settiii<i guidelines for policy. At 
least tacultv art providetf resouices *o suppuit their etfui is iu 
improve instruction. 

Student evaluation. Although Miller (1972) cites financial 
exigencies and a trend toward re-exaniination of goals and 
philosophies as two reasons for the current interest m 
instructional accountability, the original press for intehial 
accountability probably came from sttdent discontent, i his 
cause was also cited by Miller. 

The tendency has been for teaching faculty to be judged 
by their colle^igues on the basis oi their scholarship and for 
instructional/ competence to be assumed. Students, oi> the 
contrary, assume scholarly competence and seaith lor 



eviilencc of ilieir protesM)ri>' icacliing competence (Hammond. 
' ciaL, J 969). 

One inference lo be drawn is lhat people tend to look for 
evidence of compoience in areas in which ihey either: (I) feel, 
qualified to 'make judgments, or (2) h'ive an interest. Part of 
the reliiciance to pass* judgment on ilio quality any work 
dQne b> colleagues is based on the difficulty of evaluating 
work outsidc^)ne's own discipline. This accounts for each 
deparjnieni/naving'an interest in establishing unique criteria 
for evaluating its faculty. 

Suidofiis ma> feel quite confident of their abiliiv to make 
jiidgmems about n pn^fcssor's teaching in almost anv^course in 
whicii they are enroflM. Intcrekingly enough, 'a>id pei^ips 
predictably, professors d^ no accord students that capability. 
Warrington^ 1972) reported that the coi relation between the 
ratings of faculty and students as to whether items should be 
in:luded on a "Student Instructional^Rating System" was .'68 
and the correlation between whether faculty /bought studeif 
had enough' information was .54-, Astin and Lee (1966) poii^t 
out that concern with impact of instruction on the student. has 
not resulted injturning to studenjs ^s an important source of 
information ayout those hnpacts. In fact, a s'urvey of 1100 ' 
, colleges and universities revealed tliat in only 12.4 per cent of 
tliem were systematic student ratnigs used as a source of 
information in evahiatmg teaching effectiveness (Astin and 
Lee. 1966). 

Gusfad (1%7) conducied two surveys for the American 
Council on l:ducaiion, one* in I96K the second in 1966. He 
cited as major trends- (1) a substJntial decline in the use of 
'i\stenuilic student ratings. (2) a substantial decline in the use 
of classroom visitations as means for, obtaining information 
relevant to teaching pertbrmance. The utilization, of 
committee evaluations and the analysis of grade distribution^ c 
had markedly incieased'in popularity. 



— IS ek>quent testinionv to the aLademit professKHi's 
unwillingness or inability, or both, to do what ^^ 
needed to develop adequate aiid equitable methods 
for faculty evaluation (pp. 265-266). 

These j>ources of data tiiay not be suttictenth current since 
they contradict observation^ reported by several persons 
knowledgeable about activities across the rational :>cene in 
higher' ediiLaton. However. the\ are still citeJ In ,Mtiler 
(1972). 



(l\e bes 



Hildebiand (1971) suggests that students are (l\e best 
judges of the extent instuiction has made Lonstrbotive 
Lontributi^lis to their lives. His studv indicates thai dilierent 
students tend to judge the same leaLhers as havinu ma«ie 
constructive contributions to them. \ ,stud> bN Costin, et al. 
(1971) suggests that stUvlent,s* ratings wan provide reliable and 
valid information on the quality of courses and instruction. 
However, Wilson et al. ( !9":3) noted that professors commonK 
assert that onl> their colleagues ar^^ truly qualified to judge 
:ompetenc>. As Astin ^nd Lee (I960) report. 48.9 pei cent of 
trie colleges i^nd uiiiversities use colleagues' opinioi\;s as .i 
source of information concerning tCiithing elTecliveness. 
Professors evidently will not accept *tlie validity of student 
ratings if they ai^e to be used in making accountabiiity 
decisions. Perhaps this is because stuxlents and professors ditfer 
in^-Hie behaviors they describe as characteristic of effective 
teachers (Wilson, et al.. 1 973). the fact that professors and/^ 
students ex,hibit high agreement about who are effective and • 
m(;ffective teachers (Wilson, et al.. 1973) has not pe.rsUsidcu 
professors as to the merits of employing student latmgs for 
decisions related to merit, promotion, tenure, in-service 
4raining' or discharge McKeacliie (1970) thinks student 
judgments should be systematically collected foi piomotioii 
^lecisions but -that they cannot be t!ie only assessment smcq 
department chairmen ^^ilready usC student judgments tliai havv 
been obtained unsvstematicallv'. 



It is paiadoxical indeed that the academic world, 
ostensibly devoted to the co^tiQuous^ search fjor 
evidence which can \>q brouglit to bear on the 
solution of pioblems and the increase-of knowledge, 
conlimies with great equanimity to tolerate a system 
of evaluating its members wherein, as this writer said 
earlier, "to call what is typically collected or adduced 
to support evaluative decisions '^evidence" is to 
stretch the meaniifg of lhat honored word beyond 
reason/' Almost a quarter century ago. Logan Wilson 
said, "Indeed, it is no exaggeration to say that the 
most critical problem confronted in the social 
organi/.ntion of any university is the proper 
evaluation of 'faculty services, and- giving due' 
recognition through the impartial assignment of 
status.'' The almost imperceptible progiess since then 



Professors seem to tear tha4 , students and professors wiJI 
enter into a subtle collusion where the professor sejs minimal 
goals and the student accepts those bev:ause they require the 
skills .they understand (iMtKoachie, '1970). There is some 
tangentially related evidence in support of this opinion. 
Teachers found to be efTective, with bright students are rated 
higher by bright students and students who.so achievement in a 
course is above that to be preVicted from their intelligence and 
background tend to rate the ^teacher of*that course as more 
effective than djD sHi<ients whose achievement, was less ^h an 
expected (McKeachi?. 1970). Still,. Eble (1970) reports only 
,.^ht relationship between a studeni's evaluation of a course 
and his final grade. It seems logical that students should be 
able to provide information as to whethei a professor has 
perrormed in such a way that they have been able to achieve 
outputs. 
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Student rating scales i»eoin to ii,i\c iclLibiia) . c\>mi it then 
NalidilN IS que^noiicd, thauk^\en jfioaclier porfonnance aiui, 
student pertbiinance have not bc'eii found lo.coiiolate (Uonan. 

Tiie review \v Ronan (1^70) suggests thnt theie is 
a^iishictii agreement among studies ns to tlie dinicnsionN ot' 
teacher beliavioi that arc factors iii student raiums. The. scales 
lound uselul usually hicasure: 

L a dimension rehited to Ijaviiv^^ oigam/.ed and clear 
'presentations. ^ ^ 

2 a dimension of personal wainith or empathy. 

3 a dimension of enthusiasm rcHe^d by <:i\ox\. 

Ciawford and Bradshaw (in Ronan. 1971). suggest that 
different raters ai'e using different criteria and standards,' and 
tfie Klses for their judgments are going unspecilli^d. foi 
example, students may ^base their ratings on stereotyped 
pciceptions of a professor's role or personal phychological 
needs. One intensive and sophisticated effort to jdentify 
effective and ineffective teaching behaviors as seen by students 
IS liie ciitical incident study conducted at the Georgia Institute 
uf'jeclmoiogy ( Ronan . i 97 1). 

In relation to the current study, over a dozen different 
student rating scales were examined. (Manv institutions use 
the same instvuincnts.-) The> can be characteri/;ed as follo\\s; 

L Most of the items deal with process criteria, e.g.. *1s 
heiphii when students have difdculty 

2 Some items are better classified as pre.sage critLMia. 
c.g . *ilas a sense of luimor/* 

3, There are not many items that ask a student diiectlv 
. what effect the professor has had on him/her 

(product criteria), e.gV, "lias given me new 
appreciation/' 

4, Regardless of the items, they invariably require tlie 
V. . student to make infcrences^iathei than obseivations, 

e.g.. "Is well organized." ' ^ I 

Fahc\ (1070) points out that .student f.itmg scales are 
pioKiblv the most objective and reliable of all piocedures , 
employed for assessing teacliing performance, lie al.so presents 
an excellent critique of the weaknesses of such scales. 

It IS difficult U3 provide counsel as to how student rating ^ 
scales jiiight best be used, and validity depciids on ysc. Student 
rating scales are probably most useful when used to meet the 
itcLds of sludciUs. 'I hat is. with tlicir emphasis upon liaits and 
pin»,csses. thc\ sh.ould piovide iiiforiiiaUon that a student 



Could Use (o seiec|.,ph)lcsNois when ^oiUjonted with muluplc 
se<.tions of courses. In then picsent lonii. items leLtted lo 
processes louIJ bo used b\ piofessi>!> to uientiK elemenis ol 
their teaching that could be mipioved A depaitniem ^hamnai' 
i)i dean might use lire same items as a iikmiin of deieimuiing 
\\iio should leceive training .ntd wiiat iianung (he\ aie ly 
receive . ^ 

Student rating scales have limited uselulness loi 
contiibuting tb oiher accountability decisions because of the 
lack of peilormance standards. Few institutions Jiave 
established ^abM)lute standards, even at the minimuin 
acceptable levels. Standards based on iioniiative ct nparisoiis 
do not t^ind suificjeiit acceptance b\ most faculties. Such data 
also haveirt much usefulness m planning remedial piogranis. 

StudtjMii ..tings caif be given trequenth and. sf machine 
processed. are\ relalivei> inexpensive. This ncAibj|it\ is 
iiiipor'taiit since teacliuig'pefforniancc may itself change o\ei 
tune, and vary fronu)iie time to anothet. 

Classroom visitation, Accoiding lu Astm and Lee ( 
classroom visits are t5niplo)ed as a sotfrLC ol data legarding' 
teaching effectivene.s.s' bv the majority of depaitmeiits in about 
14 percent of the colleges and univeisities. Miller ("1072. pp 
30-31 ) q^uotes Silber as coiiinientnig. '1 have lieaid piolessoiv 
argue that this classroom observation violates tlic d'gnav ol 
the profession. I heard a ver\ good lespunse to lliat hv a 
piofessor of [*nglish at Vugmia. who said: 'What .i cupous 
concept oi dignitv that a man should be ashamed to be caught 
:j;^^s work. * , 

Classroom visitations aie usuallv juade bv scmoi lacukv 
members oi depilrtnieiit chairmen. The hniitatioiiN aie obvious 
Visitois observe an even siiiailei sample ol the beiia^ ums \\\ 
winch a leachc! nuisi engage than do >tudents. 1 hc\ 
frequently infei that other activities have oc».uncd pnoi to 
and will occui subsequent to what they observe in the 
classroom. Further, botii observations and inferciKCs are 
colored by the unique charaeteristi& and experience of the 
obseiver. 

Gustad (1067) reported a decline in iiumbei ol 
institution.s using classmoiii visitations between |06l lutd 
1066.* In view of the^madequacv of instiuiitents used tottuv.us 
visitTitions. aiul the abseiKe of eilhoh uiiteiia ui staiidaids foi 
iiKiking judgnieifts about iiislruLtion. sulIi dcLljiic was 
justified. I tow eve I. the data cited aic not curreiU and itia> not 
rellect present conditions. There is little evidence to ^ut^gcvt 
that visitations have been replaced bv s>s»emaUL pioLcdurcs 
with gieater validity. ^ 

An extreme example of peei judgment is desciibcd hv 
Ashb> (1073) lie points out that in British Lollcges ail laeultv 



nicinhciN. iu)\vo\cr distinguished^ jio expected to leaLli. f his is 
niotivaled by early teiuite. uniioini s*iUiry wales Ibi'' 
ujiiversmes. jnd sninll siudeiit-fijculty ratios. )st inipuitant 
note. lio\Hevei . is iliat qualiiv is iiKUiilained h\ lia\ing 
exieriiai <*xainiiiers Uom oihei universities see that iltc 
standaids a\vaiding degrees are aboul the same at uthei 
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Other methods of assessment. An obvious means by which 
a faculty member can leoort his teaclimg activities to others is 
in provide ihcni wilh self-selected evidence. Its credibiJit) is 
increased if the nature df what is to be repaitcd is announced 
bef(jre data Cv)IIe*.ticMK and if ihe piocedutes foi obtaining and 
analy^in^^ the data ^re documented. Although the most 
xequenti) used sources of information m evaluating teaching 
efto^tiveness aie chairmen, 85.1 pei cent of die institutions 
repo^g, and deans. 82.3 per cent (Astin and Lee, 1966), it is 
unclear liou the> obtain the information upon which their 
o4)inions are formed. Astiiv and Lee indicate thut while the 
judgment of a chairman or dean, confirmed by opinions of 
colleagues, was ilie most common means of evaluating an 
nidividuars ti^aclnng competency, first hand information 
played only a small *pait in forming these judgments or 
ifpiniuiis llildehraud ( 1971,) suggests that whatever ratings are 
^iven bv a Chairman nt dean shjiild be open to^ challenge b> 
the instiuclor. ^ 

In fact, niusi judgments of peets are^not based on personal 
observaiiop.s. They need not be if appiopnatc provisions are 
inad<: with the piole.ssof foi stematically ubtainnig ^data. 
Student ratmg>. ^o<fre> on pcifoimance tests, and artsfacts 
related to the course can t^e provided b> the individual 
professoi The indiMdual siioulU be ^^.tiidid about \vlucli data 
piovided IS pari of a self-reporJ and vyhich weie obtained b\ 
otheis and aie meiely being iransniiUed. 

ProNuhng {iifornuition about tea:lnng peifoimanle is 
appaiently seen by many as an obligation of tc^aching faculty. 
Such inlo nation may be used in ways that are mimical to the 
welfare ol individuals, 'departments, and even institutions. In 
Older to lULrease Lonfidence th.ii infoimation will be u>ed 
beneficially, (hige ( l^)7()b) ha^ suggested that it be subject to 
some c(Histiamis 

I. Disclosuie must be candid. Piofessors' human 
capacities loi c(i)icealmein, selective bias» disloition 
antl* expediency will be lellected in the data. A 
professor's professional mt'egritv should suggest the 
neccsMt) lor describing a^ completely as possjbic the 
, ' pioccdiires employed in obtaining; jfte information 
iep{)rtod. If ^^forniation is devekiped by a chairman 
01 eomniilj'ee, the Jiuhvidual undei consideration 




2. Coiilideiiiialu> is essential. M suppK uig intouiialion 
is to eiicouiaged.liidiNidualsmuslbe assured Ui.it ilie 
information wilLbe used as prescribed b\ peiNoiis 
whose klentit) has been revealed. That is, it should be 
uiidersio^xl vvho is-lo receive what information ^nd 
how that uifurniation is to be usQ^d 

3;. The infoimation disclosed should be as SLientifiL .:s 
possible. It should create confidence ^m its usei. 
Obser\ations and int\'rences should be clearU 
dLStingujsiied. Inferences should ,be supported hi 
observational data. Opinion^ and judgment^ should be 
clearlv identified. Wheie t'easiblc. measurement 
diould be enipUn ed Sampling of beha\K>rs related .t^j 
teachmg performance should be .is careful 1> drawn as 

^ possible SKI as to cover the variet\ of tasks related to 
tea-chin^. Standards foi judgments should be 
described. 



Adaptive Responses 



Mlind (1971) suggests that the ab»iit> to manage the 
e\ahiation-rewaid process' is the ke> to imtraimg change. One 
reasQn for suggesting • that accountability can be best 
un<ierstood if perceived as a set of tiansaetions'is because us 
components aie so interdependent. For example. 

i 

. I. Intentions must be clarified in Older to know what 
information will be needed. ' 

2. Intentions ai'e dependent upon infoimation about 
what adaptations are to be hiade 

* ?. KnowfnlJ: what adaptations to niake depends on 
information about wh^l is happening and whdi v^as 
intended to happen. 

4. 'If the infoniKyioii obtained doesiv't fu^us on 
intentioi^s, adaptations ma> be in_.4)propnate. 

5, If tly information abtained and distributed isn"! used 
m makii'ig ndapiations. the motivation to supplv 
infoimation w'lW soon disappear. 

Tollett (I</70) spi^ulates that . . if highei education has 
gieat impact upon .societ\ m an> was.*hen societ\. the public 
.sector, should want to know what that ..npact is and ^aluale, 
modify, or reinl\)rcc. as ibe situatu)ii mav icqune. tiiat 
i'mpact" (p. 62). -* 
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Informalion thai can help inslilulions improve pianning 
and management may also meet mformation needs of 
Icgiblaturs. The^tviiisequences of sucli disclosure ma> ixiuse.uhd 
legislatujc to Mnfliience mstttiitional variables rcHiled to 
instruction, e.g., facilities, number of personnel. It may be, 
iiowever, that the capacity of legislatures for adaptive decision 
making is limited. If the institutions of higher education 
Within ^a state are-unable to explain their impacts, legislatures 
ajc lestricted. largely by pubhc opinion opposing increased 
'(axes, in increasing fyiancial support. In tlie face of financial 
exigencies, the tcsponse of a legislature is liable to be p\initive. 
For example, if a particular uistitution pjaced empliasi?upon 
quality teaching, student costs miglit increase lo a pouu where 
a legislative Education committee would place the school 
under an enrolbiient 'limit, hold their budget constant, or 
employ some other meana of managing costs." 

The commitment fot. making adaptations is difficult to 
releltse. To quote Hind {1971, p. 286), "Thd evidence from 
our study, wherefn the faculty in its expression of latent 
desires, and the administration m its policy stiitements, call for 
. increased emphasis on tcaciiing while the status qub remains, 
suggests that" nothing will happen until some impetus is 
apphed/* It is difficult to ascertain just why this is* true. 
Mayhew\s (1972; term '^syndicalism'* may be appropriately - 
descriptive. TUe'autlior interprets this to encompass both the 
natural unresponsiveness due to the structure of the 
established institutions and the banding together of those with 
tucuseii and unfocused "concerns tiiat support maintaining 
accountability as it is. Many prpfessors apparently still 
perceive the university as a colloquium (Pfinister, 1970). Some 
pursue a philosophy that the university should not pursue any 
activity mconipatibie with decentralI^ed decision making. This 
suggests that press for adapting in ways to improve, instruction 
must come From the lidministration of the college. If an 
instiHition o( higher education is going^ to improve 
accwuntability so that adaptive decisions can be made, there 
will need to exist or be created: 

1. An atuiosphere where high status is perceived as 
based on expertise (Heffcriin, 1969). 

2. A rather permanent, centralized source of initiative 
for cliao^ centering in a strorjg and dominating, 
president (Hefferlin, 1969, and Maylicw, 1972). 

H \ A - 

/ * ' » . . 

The evidence seems to support the opinion that, if any 

changes in eilher external or internal accountability are to^ 

occur, there must, be powerful persons from within the 

institution who are committed to change. Commitment is not 

a sufficient cond.tlon, nor is change a silfficient objective. The 

direction of change should be toward improving accountability . 



so tliat^ the intentions of an agent or agency aie better 
under5tood]'\^by * those involved, so that valid provisions for 
iiccounting are sv stcmatized. and so that either the adaptations 
•are logically related to the evidcr^e pi^i^i^tQ. ur coiuliliuns jrc 
est^^bjished sO that the' o|>f^)rtuniT\ fo^ appropriate 
conscqueiices is available. 

Commitment must be supported by "know how." Neither 
external nor internal accountability can be changed without 
commitiiient from top fevel executive^ and without personnel 
available who have both skills and desire to improve 
accountability (Dahnke. ci a!.. 1971). It may be necossarv to 
^follow tJie advice of Roueclie. ct al.'(i9?l) and appoint lu 
each college a ''vice-presideiit in charge of heresv'' whose 
^primary expertise is m instructional inipruvement and \\liosc 
obligation is to stimulate improved instructional 
accountability I:ble (1971) recommends establishing a center 
charged with promoting effective teaching. L'lithovan ( P)70) 
suggests a ''systems analysis otYice'' (p. 58). The mere 
desicnation of such a center is sufficient to make such an 
agency suspect in the eyes of many prdtessors and 
consec uently to'weaken its inlluence. 

Hind (1971) indicates that, tn organi/atioiis with highly 
p r o f e s i o n a 1 workers, the "normal pattern f 
supenor-subordiiiate authont) relations tci:d to break down. 
He thinks that in colleges and universities the authority tciids 
tu be on a horizontal relat^uiship. This fits the ciHiception 
that, in relation ta their work, professors reject thc^upjuions 
those who, 3re not their jxjers. HirticlarK the> resent' 
interference by students and administrators . * ' ^ 

The horizontal rather than vcrtial authority lelationship 
has interesting implications in terms of accountabilit) Pccin 
become the ones who are seen as "influential evaluaturs'* (p- 
268) and who govern all phases or components of 
accountability. That ms, it is*those wl^o arejnflaential in the 
evaluation pro<;ess who are, in effect, the authority structure 
(Hind; 1971). i*ssentially this could mean that the tasks of 
improving accountability should be simplified. They haven't^ 
been. Thougli professors try to maintain the authoiity to 
establish criteria (expectations) and evaluate the performance 
of each other in relation to them, they have steadfastly refused 
to assurne tliose responsibilities in 'regard to teaching. As 
Wilson, et al. (*1973), have demonstrated, professors associate 
."being a good teacher" with: 



I. 



" This is a reasonably accurate description of what is reported to have 
occiirteJ al I'lvctgreon Statc'Collcge and Eastern Illinois .State University. 



Research Activity and Recognition ^ , 

Is well known and higiily regarded f6r his scholarly 
activity, pubHcations, and research. Confers with 
colleagues about research and keeps abreast of receiU 
developments in his field. 

Participation in the Academic Community 
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AucikK ami participates in cnmpu,s lectures, hucial 
fuiKtiuns. and stuJciit-onentcd activities. Matniainsa 
congenial relationship with colleagues^ 

Intellectual Breadth ^ ' 

Ma,s broad knowledge both within and bevund his 
field. Ls sought out by students and <^ollcagues tor 
information and aeadeniiC advice. 



4. Relations with Student:^ 



Maintains an informal and congenial relationship with 
students beyond the classroom.' Is consistently 
<w jvailabie to students for consultation about personal 
and academic concerns. 

5. Concern for Teaching ♦ * 

^ Expresses concern for teaching and consults with 
colleagues about issues related ,to teaching, (pp. 
33-34) 

Onl> Research Activity aikl Recognition was significantly 
related to the academic rank and discipline of teachers 
noininaled as effective. While Hind (1971) reports that 56 per 
cent of the professors questioned (all frbm Stanford University 
in the School of Humanities atid^ Sciences) thouglit teaching 
was cither sligiitly or not at all influential in determining 
univcnsity 'rewards, only 9 per vcnt thought, the same about 
lesearch. Fifiy-one per cent thouglit- teaching and 67 percent 
thought research should^bc^Mther extremely or very infiiiential 
in determining university rewards. 

Note that while, according to Hind, it^s the faculty as a 
body who I irgely "control the rewards system, it*fs usually the 
department Jiairman as an individual who has to defepd the 
Jnstttution against the con^pjetely incompetent tcachcF. The 
Lliairman may have to defend his actions against others on the 
staff who. for a variety of reasons, would choose to. think 
there was insufficient evidence that students were suffering 
from ins*ructionaL incompetence aTid 4bat, even if they were, 
that condition was to be preferred to crushing the^professor by 
adver:^c consequences. 



Ips hard to know justjiow geneiahzcabie arc Hind's data. 
But It would sceui rather general knowledge liial. at least ui 
the larger universities attejided by a ^arge proportion of 
undergraduate students, teaching performance is not rewarded 
by the- governance processes of the institution. Whatever 
concerns have been expressed about elevating instruction to a 
^pi)sition of importance in the reward system, institutions ha\e 
not avoided assessments of teaching performance that are 
largely unsystematic and inequitable. ' * 

U IS unrealistic to assume that teaching will improve in ^a 
context whore it is largely ignored in determining 
V consequences for teachers. While it wouM stretch the point to 
say good teaching actually results in punishment in most 
colleges, to have it go unrein forced is perhaps even more 
probable to result in i'.s deterioration. Learning theory would 
suggest that withholding reinforconient is one of the most 
powerful means of extinguishing a response. 

It does seem reasonable that an institutional governance 
structure shouU encourage good teaching by making whatever 
changes necessary. The evidence collected durmg this study 
offered very little indication thai what was'-being proclaimed 
as the primary purpose for assessing teaching performance. 
^ that is, to iinprove instruction, was in fact encouraged as a 
consequence. of eyaluation. That is. professors have not been 
obligated for either the quality of their instruction, or for 
improving their instruction. 

It should.'-bc recognized . that none of the other 
transactions in accountability are 'useful unless the 
opportunit^y is present withirvtlic eoiitractuJ relationship for 
alternative responses differentiated on the basis of the 
accounting provided. This obvious assumption sometimes goes 
unrecognized. When available resources are to be distributed 
on the basis of head cpunts rather than assessment of 
performance, the motivation to improve instruction has been 
weakened. ^Financial and political exigencies may have so 
serijusly reduced the capacity for alternative responses that«^ 
the' main purpose for accountabilfty has been weakened in the 
very face of increased pressure for improving it. 



^ ' . CHAPTER III' 

IMPROVING INSTRUCTIONAL ACCOUNTABILITY 



In the absence of empirical tests, and with the prevailing 
uncertainty as to' what accountability is, recommendations 
rela^ted to accountability seem relatively presumptuous. 
Nevertheless, on the basis of this review of information'related 
to instructional accountability and personal-professional 
judgments, some approaches to improving accountability will 
be pitfsented. . ^ ' 

Administrators sensing dissatisfaction with instruction in 
their collgge or university should examine all aspects of 
accountability in relation to the three characteristics of a 
contractual relationship suggested in tins report as critical to 
improvement: (I) expectations, (2) accounting, (3) 
adaptations. Such an investigation should be oriented toward 
identifying possible barriers, for whatever it is that is inhibiting 
instruction may lie ip accountability that is dysfunctional, (n 
addition to the barriers discussejf in thia paper, particular 
attention should be given to the article by Lopez (1970). 
Whoever is interested jn examining accountability .in a specific 
institution should consider the following: 

« 

1. A plan should be developed for investigating the 
current"' status of instructional accountability, for 
Setermining^what transactions now function to 
determine what/is expected^^what is accounted for, 
and why anci how, and what alternativr responses are' 
pc/ssible. This"^ planning' should' probably be 
undcu'taken by a relatively small task force cojnposed 
of an academitr administ^rator of higli rank who will 
^ act as the catalyst, a resource person in educational 
evaluation, and undergraduate teaching faculty 
members with some representation distributed among 
depattnientf and rank. 

' 2. The task force should famlliari£e itself with the 
literature on accountabilit>t There are guidelines for 
. almost every dimension of accountabihty, but only 
people within a ^rticular context can develop an 
* operationaj'model for a specific institution. 

3. "The entire faculty should be ke^t informed of the 
decisions made by and the actions to be implemented 
by thjs-t^isk-force. Remember the emphasis is upon 
i proving instruction. Accountabitify is a means 
more than an end. If other means present themselves, 
they may be more viable for obtaining the ends 
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desired. All those to be atTected must jiave some 
sense that ihey are. participating jn planning and 
im|5lementation. 

■J 

The' necessary resources must be mustered. Without 
resources no improvements can be expected. Viable 
accountability will requirejnstrumeni building, data 
collection, prpcessing, Informatioii distribution, 
follow-up, and monitoring. If the primary purpose of 
accountability is to be improvemcjit of instruction, 
then resources to, improve instruction must be 
available. Furthermore, discretionary funds that cm 
be used to supportlaccountability and nistructional 
improvement must be available. The idea of a system 
planning group, instructional development facility, 
institutional research office, or a similar organization 
or center must be seriously considered. This "RDDb 
center*' should have a staff trained to perform 
research, development, dissemination, mul ev^iluation 
operations in higher education. Collectively tnis staff 
should be a resource tor external and internal 
accountability requirements. The t-ask force may at 
some point in time become the advisory committee 
for this^center. ^ 



Some tasks can be an 
for: • 



iticipated and should be prepared 



a. The cpllcge^^each department, and every program 
will need to develop or select a«jt of obj^^ctives. 
These may be quite broad. They should be 
prioritized. 

b. An analysis of objei-: . so and oqiputs of the 
institutipn, the depari >, the programs, and 
each member of the staff, including the RDDE 
staff, will be .necessary. 

c. Each ob^ctive is going to have to have soma 
^ indicators (proxies) suggested, and each output 

will require that some standards be developed for 
judging the extent it is being achieved. Proxies 
should^ be weiglited. 

d. The instructional accounting system of the 
institution will need to be analyzed. 
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e. The above acitvitics ^liould 'result iti cirouliUiun 
of some si^alenicnls of whal can be expected rn 
terms of inbtructional responsibilities The task 
force or committee may liave to ^ persuade 
professors that they have obhgation to 
provide information about either/both theif own 
pcrforniimce or that of liicir students. It may be 
possible to leave wliat is provided to the 
discretion of die iiidividual professor,. or to the 
discietion of each department. 

T Agreements must be reached about wliat 
information is to be collected, how it is to be 
collected, who is expected to collect it, and who 
is to receive the information. »• ^ 

g. AgrcM^ments must be reached as to how 

information is to be u.spd, that is,jhe limits of 

adaptive responses must be defined, the dccbions 

for which information "will he used should be 

delineated. . . 

^ ^« ^ . 

Ik Dcci:Jon lules for responding to unanticipated 
requests for information should be stipulated, 
r-or example, /cquests that coujd result in 
infriniiemeni' on institutional autonomy or 
academic freedom might be denied. If there are 
frequent crisis responsejs^ to requests for 
information^ then the initiative for 
accouniabiliiy lies in ihe wrong place. If the data 
could not be acted upon, ihen to spend money 
obtaining them may be a wa^^ e of resources. If 
information is being collected thai the institution 
cannot afford to have disclosed, then 'those 
responsible foi data manage^nent are in the 
position of losing control^ If past experiences 
have suggested that data are usually used m ways 
that are inimical to the people or ihe institution, 
then assuraiigj niusi be given that such results 
will not be repeated. 

Some v)f these tasks eoiifcirand probably should, be 
delegated to departi/ients. For example, each 
ilepartment ina> decid^ how information is to be 
collected and disseminated. The resources, of the 
RDDK center should be available to departments. The 
task foicc. or advisory committee, can dev^elop 
standards for judging whethei the information and 
procedures used by each deparinieiir are satisfactory. 

Provision Miould be made to reward individuals or 
groups, e,g., deparlmenCs. of Ihe institution who 
engage in activities thai^n he judged to inipiove 
accountahilily and instruction. Providing financiaf 



rewards v.an also create ihe_ need ^ le-allocatmg 
- resources and create condiiionsof anviet>^and distiust. 
Other rewards, e.g.. recognition, should beempkned. 

7., Provision should •be made to provide released time 
and the resources of the mshtulional RDDE center 
and its peisonnel to ladividuals or agencies^ wjio 
,di.?play the greatesi;desire and have the most concrete 
plans for improving instruction.^ 
— « 

8. Someone on^the college slaff, probably fhe equivalent 
of a dean 'of instruction, working in conjunctuMnvitii 
department chairmen, should assume responsj^bilil) 
for seeing that every professor who identities a 
deficiency in his instruction has the opportunity to 
engage in appropriate training. Any professor who 

^ requests help in alle'viaimg a skill dencieiicy should be 
provided appropriate .aid. This same officer of the 
college should maintain a continuous insei^vic^ 
training program based on identified n(jeds. 

9. Professors consistently reported to be "popr" 
teachers* should be kept informed by the designated 
officer of the college cited in No.'8 above, or by the 
department chairman, or !jy a personnel committee 
of the department, of the nature of tiiese reports. 

, This IS hearsay evidence and should not otherwise be 
acted upon if the professor and the above persons can 
develop a program to asce^rlain it the reports are 
realistic, if the antecedent conditions leading to 
negative leports can be clarified, and if steps arc 
Maken to alleviate deficiencies identified In <^ither 
knowledge or skills. Professois consistently leported 
to be deficient in teachjng who resist assessment, 
refiise to provide information about instruction, 
refuse aid, or demonstrate inability to profit from it, 
should not benefit from the reward system of the 
institution unless some other aspect ofMheir work is 
so outstanding thut prestige is accrued by the 
institution. Even then, nnstnictional obligations 
should perhaps be limited. 

Lope/ (1970) makes it clear that accounfabihtv .cannot be' 
changed when administrative pioceduics, orgam/ational 
ti adit ions, staff acceptance, and methods of iniplcnienlation 
are not attuned to its purposes. It is dilTicult to niodifv ^in\ 
transaction wliithin an institution lhat does not have a 
tradition fot promoting change. So before anempting to 
modify accountability 'within ain college os umversit\. 
consideration should be giv . what is known about each of 
the -principal transactions that characleri/.e accuuntabilii\ . 
Those aspects of the college that are impinging upon the 
contractual relationship in which accountabiht\ opciatesniust 
also he carefully examined. 
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